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INTRODUCTION 


This  report  describes  the  effort  carried  out  under  Contract  No. 
AFOSR-84-0304  (9-15-84  through  1-14-86). 

The  Chapters  1-5  deal  with  the  basics  of  Multiaperture  Optics 
(MAO)  while  Chapters  6-10  describe  the  experiments  performed  and  the 
results  obtained  during  this  effort. 

The  design  of  multiaperture  devices  has  been  advanced  to  a  state 
where  it  became  possible  to  build  a  working  model  capable  of  acquiring 
simple  shapes  as  well  as  recognizing  them. 
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INSECT  VISION  AS  A  MODEL 


a.  Introductory  Remarks 

^The  development  of  optical  instrumental  at  least  the  photographic 
camera,  was  undoubtedly  Inspired  by  the  then  existing  knowledge  of  the 
anatomy  of  the  human  eye.  Therefore  it  is  probably  appropriate  to  try 
this  approach  again  for  the  development  of  a  new  type  of  optical 
instrument  based  on  the  design  of  the  insect  eye. 

While  the  anatomy  of  the  eye  was  known,  this  aid  not  mean  that 
the  functioning  of  the  eye  was  indeed  completely  understood  at  that 
time.  The  same  is  true  for  the  insect  eye.  The  anatomy  of  it  is  well 
known.  However,  the  function  of  each  of  the  components  of  the  eye  is 
still  subject  to  controversy.  It  is  not  the  objective  of  this  re¬ 
search  effort  to  get  involved  in  this  controversy.  Rather  a  different 
approach  will  be  chosen  here.  We  will  take  the  optical  components  and 
ask  what  a  designer  would  do  with  it  to  obtain  a  functional  instrument 
regardless  of  the  fact  that  there  is  the  possibility  that  nature  may 
have  used  these  components  in  a  different  way. 

Therefore,  in  the  following  we  give^a  brief  description,*  of  the 
anatomy  of  the  insect  eye  and  4a— the  nextr  rhapter  we  W41L,  design  an 
instrument  using  similar  components.  ^ 

There  are  basically  two  types  of  insect  eyes,  the  apposition  eye 
and  the  superposition  eye. 

In  general  it  is  automatically  assumed  by  the  workers  in  the 
field  that  the  insect  eye  produces  an  image  which  is  handed  over  to 
the  brain  as  such.  In  contrast  to  this  we  believe  that  the  eye  is  a 
digital  data  gathering  device,  which  performs  recognition  of  objects 
in  the  eye  itself  and  transmits  only  the  results  of  the  recognition 
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process  to  the  brain.  Nevertheless  the  mosaic  theory  of  insect  eyes 
states  that  each  eyelet  (ommatidlum)  contributes  one  point  to  the 
image  the  insect  conceives.  Depending  on  the  species,  there  can  be  up 
to  20,000  ommatidia  in  an  eye.  In  this  case,  the  image  would  be  made 
up  of  20,000  pixels,  which  would  make  an  image  of  only  moderate  qual¬ 
ity.  However,  there  are  indications  obtained  through  behavioral  re¬ 
search  that  the  insect,  indeed,  sees  quite  well.  Therefore,  our  sus¬ 
picion  is  that  one  ommatidlum  does  more  than  collect  only  one  point  of 
the  image. 

b.  The  Apposition  Eye 

Figure  1  is  a  simplified  diagram  of  the  structure  of  an  apposi¬ 
tion  eye.  The  main  optical  elements  consist  of  two  lenses  (the  cor¬ 
neal  lens  and  the  crystalline  cone)  and  a  bundle  of  7  to  8  detectors 
(the  rhabdom).  We  like  to  suggest  that  the  cone  is  a  light  horn*), 
while  the  corneal  lens  is  a  field  lens.  And,  indeed,  in  Reference  1 
it  is  claimed  that  the  crystalline  cone  is  almost  identical  to  the 
ideal  concentrator  (light  horn).  However  this  assumes  that  the  re¬ 
fractive  index  is  a  uniform  n  *  1.54,  which  is  actually  not  the  case 
for  most  eyes.  Rather,  the  index  is  changing  in  the  radial  direction. 
However,  this  should  not  modify  the  function  of  the  light  horn  too 
much.  Light,  which  enters  the  light  horn  under  an  extreme  angle  is 
reflected  back  out  of  the  entrance  aperture,  meaning  this  device  has  a 
limited  acceptance  angle.  Therefore,  the  lens  in  front  of  the  light 
horn  has  to  be  considered  as  a  field  lens,  which  regulates  the  en¬ 
trance  angle  and  consequently  the  FOV  of  the  individual  eyelet. 

The  rhabdom,  which  is  a  long  hose-like  structure,  contains  7-8 
individual  detectors  (the  rhabdomeres) .  They  are  either  separated  or 

*)  A  light  horn  (Raleigh's  light  horn)  is  a  nonimaging  optical  com¬ 
ponent.  It  is  funnel  shaped  and  concentrates  light  by  regular  or 
total  reflection. 
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Figure  1.  The  Apposition  Eye 


fused  together  as  indicated  in  Figure  2.  Most  apposition  eyes  have 
fused  rhabdoms.  In  general  an  oblique  skewed  ray  entering  any  cylin¬ 
der  with  reflecting  walls  will  spiral  down  this  cylinder.  The  rhabdom 
is  such  a  cylinder  filled  with  pie-shaped  segments  (the  rhabdomeres) . 
In  this  case,  indications  are  that  each  rhabdomere  has  a  different 
color  sensitivity  and/or  serves  as  a  color  filter  for  its  neighbors. 

The  fine  structure  of  these  rhabdomeres  consists  of  rows  of  small 
tubes,  typically  1  ym  in  diameter.  Layers,  consisting  of  several 
rows,  are  alternatingly  oriented,  90°  to  each  other  (see  Figure  3). 
These  tubes  are  called  microvilli.  The  light  is  kept  inside  the 
rhabdom  by  total  reflection  on  the  internal  walls  of  this  hose-like 
structure.  The  absorption  of  the  photon  occurs  in  one  of  these  micro- 
villis,  which  are  the  organs  which  convert  the  light  signal  into  an 
electric  signal  (or  rather  an  electro-chemical  signal). 

Each  ommatidium  is  surrounded  by  pigment  cells.  This  pigment 
serves  as  optical  insulation  between  neighboring  ommatidia. 

c.  The  Superposition  Eye 

This  type  of  eye,  as  can  be  seen  in  Figure  4,  is  similar  to  the 
apposition  eye.  The  main  difference  is  a  piece  of  fiber  optics  (the 
cytoplasmic  filament)  which  is  inserted  between  the  crystalline  cone 
and  the  rhabdom.  At  low  light  levels  there  is  little  or  no  optical 
insulation  between  the  individual  cytoplasmic  filaments.  However,  if 
high  light  levels  are  present  a  pigment  layer  is  moved  between  each 
filament  as  indicated  in  Figure  4. 

For  the  case  when  there  is  no  pigment  between  the  filaments,  the 


theory  states  that  the  image  which  is  formed  by  each  lens  spreads  out 
over  more  than  one  rhabdom,  in  fact,  a  large  number  of  rhabdoms.  This 
is,  supposedly,  true  for  each  lens  and,  therefore,  many  images  are 


superimposed.  If  properly  aligned,  they  should  form  one  superposition 
image . 

Since  not  all  entomologists  subscribe  to  this  theory,  the  super¬ 
position  eye  is  sometimes  also  called  "clear  zone  eye,”  referring  to 
the  clear  space  between  the  crystalline  cone  and  the  rhabdom. 

For  low  light  levels,  where  there  is  no  optical  insulation  be¬ 
tween  the  individual  eyelets,  a  superposition  image  is  supposedly 
obtained,  while  at  high  light  levels  the  superposition  eye  would  be 
converted  into  an  apposition  eye,  since  pigment  is  moved  between  the 
individual  eyelets,  which  makes  the  formation  of  a  superposition  image 
Impossible. 

The  fact  that  the  superposition  eye  turns  into  an  apposition  eye 
at  high  light  levels  makes  one  wonder  about  the  validity  of  the  theory 
of  the  superposition  image.  It  should  be  noted  that  in  order  to  con¬ 
vert  back  to  the  superposition  eye  not  only  does  the  pigment  need  to 
be  withdrawn,  but  also  the  refractive  index  of  the  filament  has  to  be 
made  equal  to  the  index  of  the  surrounding  liquid  to  allow  formation 
of  a  superposition  image. 

From  the  standpoint  of  a  designer,  one  would  use  the  cytoplasmic 
filament  as  a  device  which  regulates  the  FOV  of  the  individual  eyelet 
and  above  all  regulates  the  amount  of  light  (intensity)  which  is  al¬ 
lowed  to  strike  the  rhabdom.  Since  the  light  spirals  down  the  inside 
of  the  cytoplasmic  filament  by  total  reflection,  intensity  control  can 
be  accomplished  by  "frustrated  total  reflection."  This  implies  that 
the  light  travels  inside  the  filament  at  all  light  levels  and  at  all 
times,  and  is  modified  (reduced  in  intensity)  when  pigment  is  present 
in  the  liquid  adjacent  to  the  wall  of  the  filament.  In  this  case  less 


than  100%  of  the  light  is  reflected  by  total  reflection.  The  super¬ 
position  eye  is  usually  associated  with  a  separated  rhabdom  (detector 
array)  as  shown  in  Figure  2  (lower  half).  The  detectors  form  a  ring 
containing  six  detectors  which  surround  a  central  detector  number  7 
(or  to  be  precise  7  and  8  which  are  fused  together).  We  would  like  to 
assume  that  the  center  detector  sees  only  that  part  of  the  FOV,  which 
is  non-overlapping  with  the  FOV  of  the  neighboring  eyelet  while  the 
ring  of  six  detectors  detect  the  overlapping  parts  of  the  FOV.  If  the 
filament  serves  as  a  waveguide  in  both  cases,  high  light  level  and  low 
light  level,  the  introduction  of  pigment  around  the  cytoplasmic  fila¬ 
ment  would  only  change  (by  frustrated  total  reflection)  the  intensity 
carried  in  the  waveguide  but  not  change  the  method  of  data  evaluation. 

From  the  point  of  view  of  a  designer,  a  superposition  image  will 
not  offer  any  advantage  over  an  apposition  image.  The  resolution  of 
the  image  is  determined  by  the  diameter  of  the  optical  system  of  an 
individual  eyelet,  therefore,  it  has  to  be  the  same  as  for  the  ap¬ 
position  image.  The  number  of  detectors  available  to  probe  the  image 
is  also  the  same  in  both  cases.  The  retina  in  the  insect  eye  is  con¬ 
vex  (as  opposed  to  the  concave  retina  of  the  human  eye),  therefore,  a 
large  image  would  run  out  of  focus  at  the  edges  quite  soon.  Therefore 
there  is  really  no  good  reason  to  accept  the  additional  complication 
of  aligning  the  many  images  for  superposition.  Maybe  nature  does  this 
anyway,  but  for  our  optical  instrument  the  superposition  image  is  not 
an  acceptable  option. 

There  are  three  layers  of  nerve  nets  underlaying  the  insect  eye 
structure  (as  compared  to  only  two  in  the  case  of  the  human  eye)  and 
relatively  few  nerves  connected  to  the  brain.  Based  on  this,  we 


suggest  that  the  pattern  recognition  is  performed  in  these  nerve  nets, 
and  only  the  result  of  the  pattern  recognition  is  forwarded  to  the 
brain. 
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There  is  experimental  evidence  that  both  eyes  communicate  with 
each  other.  E.g.,  if  only  one  ommatidium  in  one  eye  is  illuminated, 
the  brain  checks  if  the  corresponding  ommatidium  in  the  other  eye  is 
also  illuminated.  It  can  do  this  despite  the  fact  that  only  a  few 
nerves  are  connected  to  the  brain,  meaning  that  not  every  ommatidium 
has  its  own  connection  to  the  brain.  In  order  to  select  a  certain 
ommatidium  in  the  other  eye,  the  incoming  signal  must  be  coded  with 
respect  to  the  position  of  the  illuminated  ommatidium.  This  is  a 
strong  indication  that  substantial  processing  is  performed  in  the  eye 
itself . 

For  this  reason  we  suspect  that  the  insect  eye  is  not  a  camera 
delivering  an  image  to  the  brain,  but  a  pattern  recognition  device 
delivering  a  signal  to  the  brain,  which  announces  the  kind  and  loca¬ 
tion  of  an  identified  object.  This  is  the  same  goal  we  see  for  the 
MAO  system.  It  should  not  be  thought  of  as  a  TV  camera,  providing  an 
image  for  a  human  observer,  but  as  a  device  which  recognizes  an  object 
and  announces  its  location. 
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THE  OPTICS  OF  MULTIAPERTURE  OPTICS  SYSTEMS 


a.  Introductory  Remarks  -  Why  Multiaperture  Optics? 

The  resolving  power  of  an  optical  system  is  determined  by  the 

lens  diameter.  Going  to  small  lenses  means  severe  penalty  in 
resolving  power.  Obviously  there  have  to  be  other  benefits  to  justify 
the  use  of  Multiaperture  Optics  (MAO).  It  is  safe  to  assume  that  such 
benefits  exist,  otherwise  nature  would  not  have  been  able  to  evolve 
MAO-eyes  against  what  would  otherwise  be  superior  competition.  What 
is  not  so  obvious  is  the  answer  to  the  question,  are  these  benefits  of 
any  value  for  the  optical  instrument  we  want  to  build?  E.g.,  it  could 
be  that  MAO  is  only  good  for  close  distances — less  than  the  one  focal 
length  required  for  a  one-lens  system.  This  would  make  sense  for  an 
insect,  but  may  restrict  possible  applications  for  our  optical  instru¬ 
ment  severely.  Therefore,  we  will  devote  this  chapter  to  discussing 
the  possible  answers  to  this  question. 

b.  Advantages  of  MAO 

The  more  obvious  advantages  are 

1.  Small  size 

2.  Large  FOV 

3.  No  focusing  required 

4.  Optical  Preprocessing 

while  the  obvious  disadvantages  are 

1.  Poor  resolution 

2.  One  individual  detector  is  served  by  a  smaller  aperture 
than  in  the  case  of  single  lens  optics. 

The  consequences  of  reduced  aperture  are  illustrated  in  Fig.  5. 

As  can  be  seen  in  Fig.  5a  detector  X  is  served  by  the  large  aperture 
lens,  while  detector  Y  is  also  served  by  the  same  aperture,  although 
under  a  slightly  different  angle.  In  the  case  of  MAO,  as  can  be  seen 
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In  Fig.  5b,  the  aperture  which  serves  detector  X  is  much  smaller  and 
detector  Y  is  served  by  the  neighboring  optical  system.  It  looks  as 
if,  in  the  case  of  single  lens  optics,  the  lens  is  used  repeatedly, 
while  in  the  case  of  MAO  the  light  horns  are  used  only  once.  If  one 
were  to  use  a  flat  array  as  shown  in  Fig.  5b  one  would  intercept 
considerably  less  photon  flux  per  detector  than  is  the  case  in  single 
lens  optics  in  Fig  5a.  Or,  in  other  words,  for  a  given  FOV  one  would 
intercept  the  same  photon  flux,  but  would  distribute  it  over  a  larger 
number  of  detectors.  If  it  is  not  a  flat  array  but  a  convex  one,  as 
shown  in  Fig.  5c,  depending  on  the  FOV  overlap,  more  than  one  eyelet 
covers  FOV  now,  and  FOV  could  not  be  covered  by  the  single  lens. 
Nevertheless,  one  can  see  that  if  there  is  an  intensity  problem  MAO 
may  be  at  a  disadvantage.  However,  if  there  is  sufficient  light  the 
distribution  over  more  detectors  may  be  advantageous. 

The  question  of  close  distances  and  multiple  service  of  a  single 
lens  can  be  nicely  illustrated  with  an  example  depicting  a  well-known 
device — the  faceplate.  Figure  6  shows  an  oscilloscope  camera.  If  a 
single  lens  is  used,  the  best  f-number,  which  can  be  achieved  with 
reasonable  effort,  is  around  f/1.5,  which  would  correspond  to  an  ac¬ 
ceptance  angle  u  *  34°.  If  a  faceplate  were  to  be  used,  this  angle 
could  be  considerably  larger.  For  simplicity  let's  assume  the  face¬ 
plate  consists  of  cylindrical  tubes  having  reflecting  interior  walls. 
In  this  case,  any  ray  falling  into  a  cone  with  u  <  180°  will  be  re¬ 
flected  and  delivered  to  the  detector.  Therefore,  despite  the  fact 
that  the  entrance  aperature  of  the  cylinder  is  so  much  smaller  than 
the  one  in  the  case  of  single  aperature  optics,  the  detector  actually 
receives  more  light  in  the  MAO  case.  As  can  be  easily  seen,  this 
advantage  of  MAO  disappears  if  the  light  source  is  moved  away  to  a 


large  distance 


From  this  superficial  listing  of  advantages  and  disadvantages  one 
can  already  see  what  applications  may  be  appropriate  for  MAO.  Without 
any  further  discussions  we  can  state  that  any  application  which  can  be 
accomplished  by  a  roving  TV  camera  should  not  be  attempted  with  MAO, 
since  the  performance  of  MAO  has  to  be  necessarily  inferior  to  the 
performance  of  the  TV  camera. 

However,  if  there  were  a  requirement  that  the  camera  cannot  be 
larger  than  a  postage  stamp,  cannot  be  thicker  than  1/8”  and  has  to  be 
an  inexpensive  mass  product ,  then  the  TV  camera  cannot  satisfy  the 
requirement  and  MAO  has  to  be  used,  inferior  performance  or  not.  A 
small  TV  camera  cannot  be  used  in  principle,  since  focal  length  and 
aperture  are  related  through  the  f-number  in  the  case  of  single  lens 
optics.  Such  a  relationship  does  not  exist  for  MAO;  for  a  given  focal 
length  the  total  aperture  can  be  made  as  large  as  desired.  In  our 
example  the  1/8”  thickness  limits  us  to  a  focal  length  for  the  TV 
camera  of  1/8"  and  therefore  a  single  aperture  between  1/8”  and  1/16”. 
This  already  puts  the  TV  camera  in  the  MAO  regime.  Therefore,  size  is 
the  governing  factor  and  indeed,  in  nature,  only  small  animals  use 
MAO.  One  may  argue  that  this  is  coincidental  since  the  dividing  line 
between  MAO  and  SLO  is  constituted  by  the  type  of  skeleton  (vertebrate 
or  invertebrate).  Maybe  the  exoskeleton  cannot  support  a  large 
animal,  or  a  large  invertebrate  animal  could  not  compete  because  of 
its  inferior  eye.  Whatever  the  reason  may  be,  the  fact  is  that  only 
small  animals  seem  to  be  successful  with  MAO  eyes.  Therefore,  one 
main  concern  here  is  to  find  out  if  MAO  is  at  all  useable  for  far 


distances 


However,  from  behavioral  research  we  know  that  Insects  find 


objects  by  sight,  which  are  reasonably  far  away.  Of  course  we  do  not 
know  how  well  they  see  in  the  distance,  we  only  know  they  can  func¬ 
tion. 

c.  The  Architecture  of  a  MAO  Instrument 

For  the  design  of  our  MAO  Instrument  we  will  assume  that  one 
eyelet  collects  one  pixel  of  the  overall  image.  This  is  a  design 
decision  and  is  an  option  chosen  from  three  possibilities.  The 
rational  for  rejecting  the  two  other  possibilities,  namely  superposi¬ 
tion  and  fragmented  images,  are  discussed  below.  A  fragmented  image 
is  obtained  when  one  eyelet  will  create  a  small  section  of  the  overall 
image.  (This  is  in  contrast  to  the  apposition  image,  where  one  eyelet 
creates  only  one  pixel). 

The  superposition  image  is  not  attractive  for  a  MAO  optical 
instrument,  since  the  "retina"  is  convex  by  necessity;  also,  the 
precise  alignment  of  so  many  lenses  to  obtain  good  superposition  would 
be  very  difficult. 

Ruling  out  the  superposition  image  means  one  elects  optical  in¬ 
sulation  between  the  individual  eyelets  or  at  least  to  limit  the  over¬ 
lap  of  FOVs  with  neighboring  eyelet  to  a  few  neighbors  rather  than  a 
large  number  of  neighbors  as  is  the  case  with  the  superposition  image. 

A  fragmented  image  would  have  to  consist  of  individual  small 
Images  about  the  size  of  the  eyelet.  If  limited  overlap  with  neigh¬ 
boring  eyelets  would  be  chosen,  then  the  alignment  problem  is  again  a 
consideration.  A  reasonable  number  of  detectors  would  be  required  in 
each  eyelet  (more  than  the  7  or  8  which  are  used  in  the  insect  eye). 
This  is,  of  course,  doable,  however,  it  would  require  focusing  of  each 


eyelet,  at  least  initially  during  the  assembly  process.  Once  focused 
each  eyelet  could  be  operated  as  a  fixed  focus  camera  due  to  the  short 


focal  lengths  of  the  individual  lenses. 

We  do  not  choose  the  fragmented  image  option  because  of  the  fo¬ 
cusing  requirement  during  assembly  since  we  believe  the  difficulty  to 
guarantee  focusing  of  so  many  lenses  is  overwhelming.  As  pointed  out 
above,  the  MAO  eye  has  to  be  an  inexpensive  mass  product,  otherwise 
the  optical  shortcomings  of  MAO  cannot  be  justified. 

What  remains  then  is  the  option  that  one  eyelet  acquires  only  one 
pixel  of  the  overall  image.  In  other  words,  any  intensity  in  the  FOV 
of  one  eyelet  is  collected  and  gives  rise  to  one  point  only.  The  con¬ 
sequence  is  that  the  location  of  the  image  point  is  determined  by  the 
eye  architecture  and  is  not  an  image  of  a  real  object  point.  There¬ 
fore,  imaging  optics  are  no  longer  necessary.  All  the  optics  has  to 
do  is  to  collect  all  light  within  the  FOV  of  the  eyelet.  It  is  not 
necessary  that  this  light  be  collected  into  a  point  (or  rather  an  Airy 
disk),  it  could  be  a  ring  or  an  odd  shaped  figure. 

For  reasons  of  ease  of  manufacturing,  it  is  here  proposed  to  use 
light  horns  as  optical  elements.  A  light  horn  is  funnel  shaped  and 
has  reflecting  walls.  It  does  not  form  an  image  of  an  object  point, 
but  it  concentrates  light  within  its  FOV.  Rays  impinging  on  the 
entrance  aperture  but  coming  from  outside  the  FOV  of  the  light  horn 
are  reflected  back  out  through  the  entrance  aperture. 

d.  Detector  Array 

Whatever  the  optical  system  may  be — SLO  (single  lens  optics)  or 
MAO— it  is  certain  that  a  large  number  of  detectors  are  required.  The 

Q 

human  eye  contains  10  detectors  (rod  and  cones),  insects  have  up  to 


20,000  eyelets  with  7-8  detectors  each  which  is  considerably  less,  but 
still  on  the  order  of  10^.  Obviously  for  our  MAO  instrument  we  are 
looking  for  similar  numbers. 

A  good  question  is,  what  exactly  this  number  should  be?  A  large 

number  of  detectors  also  requires  a  large  processing  capability.  If 

MAO  is  to  be  a  small  system  and  an  inexpensive  mass  product,  it  is  not 

reasonable  to  connect  it  to  a  large  computer.  As  a  matter  of  fact, 

the  computing  should  be  done  in  the  MAO  device  itself. 

The  trend  of  reduced  number  of  detectors  starting  from  the  human 
8  5 

eye  at  10  down  to  10  for  insect  eyes  is  probably  caused  by  reduced 

processing  capacity,  the  volume  of  the  human  brain  is  certainly  larger 

than  the  insect  brain  by  a  factor  which  is  considerably  larger  than 
3 

10  .  The  consequence  is  that  for  our  M0A  instrument  this  number 
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should  be  even  smaller.  Several  times  10  is  a  reasonable  assumption. 
(At  present  we  are  using  128  x  256  =  3.3  x  10^.) 

The  size  of  each  detector  for  an  imaging  system  should  be  equal 
to  the  size  of  the  Airy  disk  created  by  the  lens  used.  If  the  indivi¬ 
dual  detector  element  is  made  larger,  the  resolving  power  of  the  sys¬ 
tem  is  determined  by  the  detector's  size  rather  than  by  the  diameter 
of  the  lens. 

The  physical  size  of  the  Airy  disk  is: 

A<J  -  2.44A(f#)  (1) 

A^:  diameter  of  Airy  disk,  A;  wavelength,  while  the  angular 
resolution  is 

a  -  2.44  A 

(A:  wavelength,  D  lens  diameter). 

This  means  that  for  the  human  eye — depending  on  the  wavelength 
under  consideration — A.*  1.5pm,  which  happens  to  be  the  size  of  some 


of  the  rods  and  cones.  Therefore,  even  a  relatively  small  lens  (D 
between  2  and  8  mm)  forces  the  designer  to  use  an  enormous  number  of 
detectors  (10®  in  case  of  one  human  eye)  if  the  system  is  designed  to 
be  diffraction  limited  rather  than  limited  by  detector  geometry. 

There  is  no  hope  that  such  a  large  number  of  detectors  could  be 
handled  in  real  time  by  any  computer.  Therefore,  we  have  to  resign 
ourselves  to  fewer  detectors  and  consequently  forget  a  diffraction 
limited  system.  Therefore  number  and  size  of  the  detectors  will 
determine  the  resolving  power. 

Ideally  one  would  like  to  have  a  curved  detector  array.  For 
single  lens  optics  it  should  be  a  concave  array,  as  is  the  human 
retina,  while  for  multiaperture  optics  it  is  a  convex  array.  Unfor¬ 
tunately  such  arrays  do  not  exist  and  the  development  of  such  an  array 
would  be  very  expensive.  Therefore  a  flat  array  needs  to  be  used. 
Based  on  above  discussions  an  array  having  128  x  256  (32768)  detectors 
seems  to  be  a  reasonable  device. 

Figure  7  shows  a  schematic  design  of  the  MAO  device  using  a  flat 
mask  and  a  flat  array.  However,  this  is  for  illustration  only,  the 
real  MAO  device  has  to  have  a  convex  mask  surface.  In  Figure  7  the 
individual  components  of  the  MAO  device  are  shown.  They  are,  the 
field  lens  and  the  light  horn  as  the  optical  system,  the  detector 
array,  which  has  its  own  memory  and  a  hard  wired  board  which  can  mani¬ 
pulate  the  contents  of  the  memory  including  an  algorithm  for  recogni¬ 
tion. 

A  detector  array  which  has  a  built-in  memory  is  already  in 
existence — it  is  the  optic  RAM.  We  use  at  present  the  "IS32A  Optic 
RAM”  manufactured  by  Micron  Technology,  Inc. 


Since  a  flat  detector  array  is  almost  unavoidable  and  a  convex 
surface  is  required,  an  adaptor  is  a  necessity.  This  allows  the 
building  of  the  MAO  mask  (containing  field  lenses  and  light  horns)  in 
a  convex  arrangement.  The  adapter  then  couples  the  MAO  mask  optically 
to  the  flat  detector  array.  The  adaptor  can  be  a  regular  faceplate 
using  optical  fibers,  or  if  no  suitable  fibers  are  available  for  the 
wavelength  under  consideration,  cylinders  with  reflecting  walls  may  be 


4.  OPTICAL  PREPROCESSING 


a.  Introductory  Remarks 


MAO  devices  consist  of  a  multitude  of  individual  eyelets.  It  is 
only  reasonable  to  expect  that  each  eyelet  is  more  autonomous  than  an 
individual  receptor  of  a  single  lens  eye.  “More  autonomous"  means 
that  each  eyelet  can  fulfill  several  functions  and  may  or  may  not  for¬ 
ward  its  findings  to  the  main  computing  structure. 

It  is  fairly  obvious  that  the  main  problem  in  pattern  recognition 
or  even  just  image  evaluation  is  the  mass  of  data  which  has  to  be  pro¬ 
cessed.  Therefore  any  preprocessing  is  certainly  worthwhile.  Data 
processing  is  usually  done  by  electronic  means.  It  is  proposed  here 
that  some  preliminary  data  processing  can  be  done  optically.  Strictly 
speaking,  optical  preprocessing  is  already  practiced  if  the  detector 
is  larger  than  the  Airy  disk.  This  is  actually  an  integration  over 
several  pixels,  which  the  lens  generates.  Similarly,  practices  like 
placing  a  veil  in  front  of  a  photographic  camera  objective  to  create  a 
softer  portrait  qualifies  as  optical  preprocessing. 

However  in  MAO  devices ,  due  to  the  increased  degree  of  autonomy 
of  the  individual  detecting  unit,  more  than  simple  integration  can  be 
done  in  terms  of  optical  preprocessing.  These  various  possibilities 
shall  be  discussed  in  this  chapter. 

b.  Overlap 

For  the  simple  apposition  eye,  as  considered  for  our  MAO  design, 
the  FOV  of  an  individual  eyelet  should  give  raise  to  one  pixel  only. 

In  other  words,  any  intensity — whatever  it  may  be,  a  point  light 
source  or  an  extended  light  source — found  in  the  FOV  will  produce  one 
pixel  of  the  image  to  be  collected.  However,  as  will  be  shown  in  a 
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later  chapter.  In  the  case  of  the  light  horn  it  makes  a  difference 
where  within  the  FOV  a  point  light  source  is  located  and  in  the  case 
of  a  parallel  beam,  under  which  angle  it  is  incident.  Therefore  the 
possibility  exists  to  extract  some  more  information  out  of  the 
observed  intensity  even  though  the  light  horn  is  non-imaging.  This,  of 
course,  requires  a  multitude  of  detectors  rather  than  the  one  which 
would  be  required  to  observe  just  one  object  point. 

If  such  a  design  decision,  namely  to  use  more  than  one  detector 
per  eyelet,  is  made,  another  possibility  opens  up  which  is  to  allow 
overlap  of  the  FOV's  of  neighboring  eyelets.  If  this  option  is  exer¬ 
cised,  some  sorting  of  the  received  information  using  the  several 
available  detectors  becomes  necessary.  In  this  case  light  coming  from 
a  given  point  in  space  is  received  by  more  than  one  eyelet  and  there¬ 
fore  it  is  conceivable  that  coincidence  methods  may  be  used  during  the 
detection  process.  Such  a  scheme  could  certainly  be  termed  as  ad¬ 
vanced  optical  preprocessing.  For  this  reason  FOV  overlap  shall  be 
discussed  now  in  somewhat  greater  detail. 

Figure  8  shows  a  central  detector  (c)  surrounded  by  6  peripheral 
detectors  (1-6).  The  circle  (IFOV)  represents  the  field  of  view  which 
is  perceived  by  the  central  detector  only.  The  light  horn  shall  be 
designed  in  a  way  that  the  field  of  view  of  the  central  detector  is 
not  overlapping  with  the  one  of  the  neighboring  eyelet.  This  part  of 
the  FOV  shall  be  called  individual  FOV  (IFOV).  However,  the  other  de¬ 
tectors  will  perceive  the  rest  of  the  FOV  of  the  eyelet.  The  FOV 
which  all  seven  detectors  will  perceive  shall  be  called  total  FOV 
(TFOV).  The  TFOV  partially  overlaps  with  the  TFOV's  of  the  neighbor¬ 
ing  eyelets.  The  circles  shown  in  Figure  8  are  arbitrarily  selected 


IFOV 


for  a  certain  object  distance.  The  diameter  of  these  circles  in¬ 
creases  with  the  object  distance  as  shown  in  Fig.  9.  As  can  be  seen 
for  a  flat  mask  the  greater  the  distance,  the  more  eyelets  overlap. 
(The  same  situation  would  hold  for  a  mask  having  only  minor  curva¬ 
ture.)  The  consequence  is  that  an  object  becomes  actually  larger  if 
its  distance  from  the  eye  is  increased,  unless  steps  are  taken  to  use 
only  the  IFOV’s  for  pixel  formation,  meaning  only  the  central 
detectors  should  be  used  for  pixel  definition.  The  rest  of  the 
detectors  are  to  be  used  for  other  tasks.  One  such  task  could  be  to 
probe  the  intensity  distribution  of  the  “footprint"  of  the  light  horn. 

A  point  light  source  within  the  FOV  of  eyelet  (TFOV)  would 
illuminate  all  7  detectors  albeit  not  uniformly.  The  intensity  dis¬ 
tribution  would  depend  on  the  location  of  the  point  light  source. 

Only  a  large  extended  light  source  at  infinity  would  cause  a  timely 
uniform  illumination  of  all  seven  detectors.  Therefore,  for  most 
applications  one  expects  an  intensity  distribution  pattern.  Once  a 
certain  distribution  pattern  for  a  certain  situation  is  known  for  a 
given  light  horn,  some  conclusions  can  be  drawn  from  the  output  of  the 
seven  detectors.  There  is,  of  course,  only  a  very  limited  number  of 
conclusions  which  have  to  be  compared  to  the  large  number  of 
intensity  combinations  which  could  be  expected  if  the  seven  detectors 
were  illuminated  by  a  large  single  lens  and  therefore  would  constitute 
7  pixels  of  an  image.  Since,  in  the  case  of  the  light  horn,  the  in¬ 
formation  obtained  by  the  illumination  of  the  seven  is  of  a  different, 
more  general  nature  than  the  information  consisting  of  seven  pixels 
obtained  by  a  single  large  lens,  one  can  say  that  the  light  horn 
Indeed  performed  some  optical  preprocessing. 
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c.  Distance  Perception 

As  pointed  out  above,  allowing  FOV  overlap  creates  the  possibil¬ 
ity  of  collecting  information  which  is  in  addition  to  the  mere  fact 
that  one  certain  pixel  exists  and  has  a  certain  intensity.  This 
additional  information  can  produce  knowledge  concerning  distance  of  an 
object,  or  motion  of  an  object  or  can  be  used  to  reduce  noise  by  using 
coincidence  techniques. 

Figure  9  shows  that  the  overlap  increases  with  distance.  The 
figure  also  shows  that  for  a  given  object  size  there  exists  a  maximum 
number  of  detectors  which  "see"  the  object  when  placed  at  a  large 
distance. 

For  a  curved  mask,  the  true  size  of  an  object  can  be  obtained 
from  the  detectors,  which  have  a  non-overlapping  FOV  (refer  to  Figure 
8).  For  those  detectors  the  image  will  become  smaller  with  distance, 
meaning  the  farther  away  the  object,  the  fewer  the  number  of  pixels  it 
will  contain.  On  the  other  hand,  the  number  of  pixels  seen  by  detec¬ 
tors  having  overlapping  FOV  will  increase.  Therefore  the  ratio  of 
this  number  gives  a  relationship  for  distance  of  the  object. 

d.  Motion  Detection 

Motion  detection  is  widely  employed  using  single  lens  optics. 

The  most  straight-forward  approach  is  to  subtract  two  consecutive 
frames  from  each  other,  threshold  it  for  noise  and  if  a  residual  in¬ 
tensity  is  obtained  the  conclusion  is  that  something  has  moved  or 
something  has  changed  intensity.  For  applications  to  non-self lumi¬ 
nescent  objects,  the  conclusion  that  motion  has  taken  place  is  pro¬ 
bably  correct,  since  a  change  in  illuminating  intensity  would  affect 
all  objects  similarly. 


Obviously  an  SLO  method  will  be  Insufficient  if  applied  to  lumi¬ 
nescent  objects.  In  this  case  one  would  have  to  recognize  the  object 
first  (at  least  its  outlines)  and  then  recognize  it  again  in  the  next 
frame,  then  compare  their  locations  before  one  can  be  sure  that  the 
object  has  actually  moved.  This  requires  a  substantial  effort  in 
image  evaluation.  However  it  is  easy  to  see  that  a  measurement  of 
intensity  ratios  between  two  different  spatial  locations  will  not 
suffice,  since  the  reason  for  a  change  in  intensity  may  be  either  a 
movement  or  fluctuation  in  luminescence. 

However,  in  the  case  of  MAO,  the  overlap  of  FOVs  opens  up  an 
avenue  to  use  intensity  ratios  only,  rather  than  having  to  recognize 
the  object  first  and  then  trace  its  movement.  The  reason  is  that  if 
the  object  changes  its  intensity,  all  the  detectors  in  the  overlapping 
part  of  the  TFOVs  will  see  a  proportional  change.  If  the  object 
moves,  some  of  the  TFOVs  will  no  longer  see  it,  some  will  see  less  and 
some  will  see  more.  Therefore,  an  intensity  ratio  measurement  will 
indeed  suffice  to  detect  motion. 

e.  Coincidence  Detection 

The  FOV  overlap  can  also  be  used  to  analyze  short  time  phenomena. 
If  there  should  be  a  light  flash  in  a  given  point  in  space,  a  single 
large  lens  would  deliver  this  light  flash  to  one  detector  only.  (As- 
uming  the  object  point  produces  an  Airy  disk  which  is  the  size  of  the 
detector).  In  case  of  MAO  several  eyelets  will  see  the  light  flash 
since  the  TFOVs  overlap.  It  is  predictable  how  many  and  which  eyelets 
should  see  the  flash.  Therefore,  from  ratio  of  the  number  of  eyelets 
which  actually  report  seeing  the  flash  and  the  number  of  eyelets  which 
actually  should  see  it,  the  probability  that  the  observed  flash  is  a 
signal  rather  than  noise  can  be  computed. 


Requiring  multiple  observations  at  a  given  time  is  known  as  coin¬ 
cidence  detection.  Since  probabilities  multiply,  this  is  a  very 
powerful  technique.  E.g.,  if  the  signal  to  noise  ratio  (SNR)  is  known 
to  be  1  for  a  given  phenomena,  then  if  only  one  detector  is  exposed  to 
it  the  probability  that  the  observed  output  is  caused  by  noise  is  0.5 
(50%).  However,  if  two  detectors  are  exposed  and  report  an  output, 
the  probability  that  it  is  caused  by  noise  is  only  0.25  and  in  case  of 
3  detectors  it  would  be  0.125,  etc. 


5.  APPLICATIONS  FOR  MAO 


a.  Introductory  Remarks 

Since  MAO  exists  in  nature,  it  is  probably  safe  to  say  that  after 
many  million  years  of  evolution  the  optimum  configurations  for  such  a 
design  have  been  achieved.  Therefore  a  man  made  MAO  device  will  have 
to  resemble  an  insect  eye  to  some  degree.  Obviously  one  wants  to 
utilize  the  wide  FOV,  which  eliminates  the  need  for  scanning  and  due 
to  the  requirement  for  a  reasonable  resolving  power  the  total  FOV  has 
to  be  divided  in  a  large  number  of  individual  FOVs  which  leads  to 
small  entrance  apertures.  (Large  entrance  apertures  could  be  used,  of 
course,  but  then  the  need  for  a  multitude  of  them  becomes  question¬ 
able.) 

Considering  all  this  one  can  expect  the  MAO  eye  to  be  the  size  of 
a  postage  stamp  with  individual  entrance  apertures  of  100  pm  for  visi¬ 
ble  light.  The  smallness  of  the  eye  would  make  it  prohibitively  ex¬ 
pensive  unless  microchip  technology  is  used. 

To  point  out  the  potential  of  MAO,  we  will  discuss  briefly  some 
possible  applications  of  MAO. 

b.  General  Camera 

A  multiaperture  camera  could  be  used  as  an  all  purpose  eye  for 
a  vehicle  (cruise  missile,  ships  lookout,  robot,  land  mine  detector, 
tailguard,  etc.).  Since  a  hard-wired  board,  which  can  contain  recog¬ 
nition  codes,  will  be  an  integral  part  of  the  eye,  it  can  recognize 
objects  and  give  steering  commands  to  a  vehicle. 

c.  Motion  Detector 

A  MAO  eye  in  the  shape  of  a  hemisphere  can  be  mounted  on  the 
celling  of  a  room  to  be  safeguarded.  The  eye  will  be  programmed  to 
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check  for  motion  rather  than  recognition  of  shapes.  This  is  probably 
the  most  simple  application  for  MAO.  As  can  be  gathered  from  the 
discussions  earlier  in  this  report  the  motion  detector  is  very 
powerful  since  it  can  work  with  coincidences.  The  algorithms  for  it 
are  much  simpler  than  the  ones  for  recognition  schemes.  (This  would 
be  a  very  simple  device  which  could  be  mounted  on  ships  to  look  out 
for  moving  objects.) 

d.  Tracking  and  Measuring 

Unpredictable  phenomena  like  meteor  traces  or  lightning  paths  can 
be  followed  by  a  hemispherical  eye,  similar  to  the  motion  detector 
mentioned  above.  Only  this  time  the  eye  is  programmed  for  recognition 
of  simple  shapes.  Such  an  instrument  could  be  used  to  do  statistics 
on  lightning  or  meteor  showers.  It  could  also  be  used  for  solar 
research  although  the  sun  travels  slower.  In  this  case  the  size  of  an 
Individual  FOV  will  be  chosen  so  that  it  will  just  be  filled  by  the 
image  of  the  sun.  The  rest  of  the  eyelet  will  then  be  used  to  collect 
data  concerning  the  scattered  radiation,  cloud  coverage,  etc. 

e.  Robotics 

One  problem  encountered  with  robotics,  which  is  new  compared  to 
conventional  automation,  is  that  the  robot  can  move  its  arms  freely 
and  it  can  smash  into  objects  or  people.  Therefore  a  visual  system  to 
prevent  such  mishaps  would  be  very  desirable.  It  is  easily  seen  that 
a  TV  camera  mounted  on  a  central  location  (head)  of  the  robot  would 
require  a  large  amount  of  computing  power  to  recognize  objects  and 
correlate  them  in  respect  to  the  position  of  the  arms.  Obviously  it 
is  impractical  to  mount  a  TV  camera  on  the  moving  arm.  However  a 
postage  stamp  sized  MAO  eye  can  be  easily  mounted  on  the  "hand.”  It 
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will  not  be  bothered  by  acceleration  and  deceleration.  With  a  pair  of 
these  MAO  eyes  mounted  triangulation  can  be  performed  which  would  tell 
the  system  how  far  away  the  interfering  object  is.  Obviously  only  the 
fact  that  an  interfering  object  is  present  needs  to  be  detected,  not 
what  it  is.  Therefore  a  simple  recognition  scheme  which  is  of  course 
handled  in  the  eye  itself,  will  suffice.  Also  since  MAO  is  non- image 
forming,  focussing  of  the  eye  is  not  required,  which  is  very  important 
for  this  particular  application. 

A  hand  mounted  eye  could  also  be  used  to  find  and  identify  a 
certain  part  which  the  robot  needs  to  install.  Here  of  course  a  more 
sophisticated  recognition  scheme  will  be  necessary.  However,  since 
a-priori  knowledge  exists,  how  the  part  looks  like,  the  peculiarities 
of  MAO  can  be  used,  so  that  the  eye  would  only  recognize  the  desired 
part  while  all  other  objects  will  be  classified  as  interfering  objects 
and  will  only  become  a  concern  if  they  are  close  enough  to  interfere 
with  the  movement  of  the  arm. 

f .  Parts  Inspection 

As  can  be  sensed  by  reviewing  the  applications  discussed,  so  far 
MAO  is  best  applied  to  situations  where  low  resolving  power  and  simple 
recognition  schemes  are  inadequate.  A  very  good  example  is  parts 
Inspection.  For  example,  if  one  wanted  to  inspect  beverage  bottles  on 
the  production  line  for  cleanliness,  absence  of  cracks,  and  absence  of 
foreign  mass,  the  recognition  scheme  seems  to  be  so  complicated  (and 
therefore  expensive  to  develop)  that  still,  in  many  instances,  a  human 
inspector  is  used.  MAO  however  fills  these  requirements  with  ease. 
Each  individual  FOV  inspects  a  certain  volume  element  in  the  bottle. 


It  is  easy  to  define  which  ones  have  to  be  empty  and  which  ones  do 


34 


not.  If  there  is  a  foreign  object  in  the  bottle,  only  this  fact  has 
to  be  detected,  rather  than  the  shape  of  the  object  itself.  There¬ 
fore,  if  one  or  more  of  the  FOVs  show  a  low  intensity  which  should 
show  high  intensity  (empty)  this  is  already  sufficient  to  reject  the 
part.  A  smudge  on  the  surface  of  the  bottle  can  be  detected  with 
intensity  ratios  between  neighboring  eyelets.  The  same  is  true  for 
cracks.  It  is  also  easy  to  adjust  for  different  glass  coloration  by 
simple  averaging  over  the  eyelets  which  view  the  empty  part  of  the 
bottle. 

g.  Gazing  Sensors 

Future  military  requirements  will  contain  a  greater  necessity  to 
detect  in  which  direction  (e.g.,  in  respect  to  his  helmet  or  in 
respect  to  the  airframe)  a  pilot  looks.  For  this  reason  the  movement 
of  his  eyes  has  to  be  monitored  and  the  center  of  the  pupil  has  to  be 
recognized.  A  MAO  device  is  small  enough  to  be  mounted  in  the  rim  of 
the  helmet  and  observe  the  pilot  eyes  without  interfering  with  his 
vision  and  without  adding  an  undue  amount  of  weight  to  the  helmet.  It 
is  even  possible  to  mount  the  device  in  the  lower  (unused)  part  of  the 
eyelgasses.  The  recognition  scheme  is  very  simple  and  can  be  accom¬ 
plished  inside  the  MAO  device. 

h.  Blind  Man’s  Eyes 

A  set  of  eyes  which  recognizes  objects  and  points  out  kind  and 
position  of  such  objects  by  verbal  communications  would  be  an  invalu¬ 
able  aid  for  blind  people.  In  principle  this  could  be  accomplished  by 
two  TV  cameras  served  by  a  large  computer.  Obviously  such  a  system 
would  not  be  very  practical.  However  MAO  devices  are  small  enough 
that  they  could  be  carried  by  a  person.  Recognition  is  done  in  the 
MAO  eye  already.  What  still  needs  to  be  added  is  a  speech  synthesizer 
which  translates  the  output  of  the  MAO  device  into  words. 


Only  simple  shapes  would  have  to  be  recognized.  For  example,  if 
an  object  is  dead  ahead  the  shape  of  the  object  is  not  very  important 
but  its  distance  is.  This  distance  can  be  obtained  by  triangulation. 


Also  moving  objects  are  of  importance.  Any  movement  has  to  be  con¬ 
sidered  as  a  threat  and  therefore  detection  of  movement  (motion 
detector)  could  be  done  without  recognition  of  the  moving  object. 

Here  recognition  of  simple  shapes  goes  along  with  low  resolution  and 
makes  this  a  practical  device  for  a  blind  person  to  wear.  Only  a  few 
words  would  be  required  for  the  speech  synthesizer.  They  could  be 
pre-stored  in  a  chip  and  called  wjien  needed. 

i.  Application  to  X-rays 

Regular  X-ray  "images"  are  actually  not  images  but  shadowgraphs. 
CAT-scans  are  computed  images.  If  a  collimator  mask  is  added  to  the 
MAO  device  it  becomes  an  X-ray  imaging  device.  The  collimator  mask  is 
made  of  lead  and  has  a  multitude  of  small  cylindrical  holes  in  the 
lead.  The  diameter  of  these  cylinders  is  equal  the  entrance  pupil  of 
the  individual  MAO  eyelets  and  the  axis  of  each  cylinder  coincides 
with  the  optical  axis  of  the  particular  eyelet  it  serves.  The  light 
horns  in  the  eyelets  are  filled  with  a  scintillation  material.  The 
light  generated  by  the  X-rays  is  detected  by  the  detectors  mounted 
underneath  the  light  horns.  Such  a  MAO  device  could  be  built  in 
larger  sizes  so  that  the  total  aperture  would  be  larger  than  a  pinhole 
in  an  X-ray  pinhole  camera. 
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EXPERIMENTAL  DEVICE 


The  multiaperture  device  consists  of  a  detector  chip  and  the  MAO 
mask.  The  detector  chip  is  an  optical  RAM  manufactured  by  Micron 
Technology,  Inc.  The  designation  is  IS32A  OPTICRAM.  It  nominally 
contains  two  arrays  of  128  x  256  (each)  silicon  detectors  although  not 
all  detectors  are  actually  in  place.  Sensitivity  is  2|J/sq.  cm.  at 
900  nm.  Each  detector  is  6.4  x  6.4  micrometers  in  size.  They  are 
arranged  as  indicated  in  Figure  10a.  The  distance  between  rows  is  6.8 
micrometers  (center  to  center).  The  distance  between  two  neighbors 
in  a  given  row  is  8.6  micrometers  center  to  center.  The  somewhat  un¬ 
conventional  arrangement  of  detector  forces  the  user  either  to  fill  in 
the  missing  pixels  (in  Fig.  10a)  by  best  guesses  or  omit  certain  de¬ 
tectors  as  indicated  in  Fig.  10b.  Now  only  the  detectors  marked  by  an 
X  are  used.  This  reduces  the  array  to  64  x  128  detectors.  Each  de¬ 
tector  element  can  be  individually  addressed.  Figure  11  shows  a  pho¬ 
tograph  of  the  IS32A  chip  and  a  chip  with  the  MAO  mask  mounted. 

The  MAO  mask  consists  of  a  glass  plate,  which  features  a  large 
number  of  cylindrical  holes.  The  diameter  of  each  hole  is  100  micro¬ 
meters.  The  distance  between  the  holes  is  about  75  micrometers  (150 
micrometers  from  center  to  center).  Figure  12  shows  a  microscope  pho¬ 
tograph  of  the  mask,  while  Figure  13  shows  a  sketch  depicting  how  the 
mask  is  attached  to  the  chip.  The  mask  is  bent  with  a  radius  of  75  mm 
so  that  the  angle  between  neighboring  eyelets  is  0.12  degrees.  The 
mask  has  a  diameter  of  13  mm  although  only  an  area  of  about  2  x  5  mm 
(the  size  of  the  detector  array)  is  used. 


Figure  12. 

Microscope  Photograph  of  MAO  Mask 


Detector  Plane 
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MAO  Device,  Dimensions  in  mm. 
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Since  the  center  distance  between  holes  is  200  micrometers ,  a 
matrix  of  10  x  25  holes  is  located  over  the  detector  array.  Each  hole 
should  have  a  footprint  containing  11  x  11  spaces  for  detectors  which, 
however,  are  not  all  occupied.  Figure  14  shows  such  a  11  x  11  field. 
The  "footprint”  of  the  round  hole  is  drawn  slightly  larger  in  order  to 
account  for  the  small  gap  between  exit  aperture  and  detector  plane. 

The  detectors  which  are  actually  in  place  are  marked  with  "x."  The 
detectors  actually  used  are  indicated  by  a  circle  around  the  x.  Count¬ 
ing  the  actual  detectors,  one  finds  that  there  are  2  in  the  512  direc¬ 
tion  and  6  in  the  128  direction.  As  will  be  seen  in  the  next  chapter, 
the  bit  map  reveals  that  on  the  average  2.25  x  7  detectors  are  effec¬ 
ted  by  one  hole  giving  an  aspect  ratio  of  approximately  3:1.  This  is 
the  actual  "footprint"  of  the  hole,  meaning  those  detectors  directly 
underneath  it  which  are  used.  There  are,  of  course,  other  detectors 
which  are  underneath  void  spaces  (the  spaces  between  holes).  Since 
there  is  a  small  gap  (0.05  mm)  between  the  hole  exit  and  the  detector 
plane,  oblique  rays,  namely  those  which  have  been  reflected  one  or 
more  times  at  the  walls  of  the  individual  holes  will  illuminate  the 
detectors  located  under  the  void  spaces.  The  walls  of  the  holes  are 
dark  glass,  so  the  reflected  rays  will  be  of  diminished  intensity. 

The  computer  program  will  let  the  charges  on  the  detectors  accumulate 
(soak)  for  a  selectable  exposure  time  and  then  read  the  values  above  a 
certain  threshold  value.  Therefore,  if  the  exposure  time  is  kept 
short  only  the  detectors  directly  underneath  the  holes  will  report 
intensity,  while  at  longer  exposure  times  the  detectors  underneath 
void  spaces  will  also  see  some  light.  In  other  words,  at  short  ex¬ 
posure  times  a  target  will  appear  to  be  depicted  by  individual  dots 


(footprints)  while  at  longer  exposure  times  these  dots  will  grow 
together  to  a  homogeneously  filled  area. 

It  would  be  preferable,  of  course,  to  have  conical  holes  (light 
horns)  Instead  of  cylinders.  Also,  the  walls  of  the  cones  should  be 
coated  with  a  highly  reflecting  layer.  In  addition,  the  cones  should 
be  closer  together  than  one  diameter  of  the  entrance  aperture.  We 
will  be  able  to  accomplish  this  in  the  near  future.  This  should  im¬ 
prove  the  performance  of  the  device  drastically. 

The  way  the  mask  with  the  cylindrical  holes  were  made  limited  the 
radius  of  curvature  and  therefore  the  FOV.  We  anticipate  having  masks 
with  shorter  radius  of  curvature  also  available  in  the  near  future. 


7.  PERFORMANCE  OF  THE  MAO  DEVICE 

In  the  following  a  few  examples  of  the  performance  of  the  present 
MAO  device  are  given.  During  the  present  effort  no  attempt  was  made 
to  compensate  for  the  FOV  overlap.  Therefore  the  device  works  best  at 
close  distances.  All  of  the  images  shown  here  are  of  close  distance. 
First  we  will  explore  how  many  detectors  are  within  the  output  cone  of 
one  light  horn.  These  output  cones  overlap  since  there  is  a  small  gap 
between  detector  and  MAO  mask.  Therefore,  in  regular  operation  the 
detectors  located  inside  an  image  are  all  illuminated  and  a  uniform 
exposed  area  is  returned  on  the  monitor  screen.  However,  it  is 
possible  to  make  the  footprints  of  the  individual  light  horns  visible 
by  underexposing  and  thresholding.  In  this  way  only  these  detectors 
which  are  directly  under  the  opening  of  the  light  horns  are  visible. 
This  can  be  seen  In  Figure  15  which  is  an  underexposed  "plus"  sign. 

The  individual  spots  represent  the  footprints  of  each  lighthorn  in¬ 
volved  in  making  the  image.  In  order  to  make  the  individual  detector 
in  each  footprint  visible,  the  image  is  presented  as  binary  image  in 
Figure  16.  The  pixels  indicated  by  a  ”1”  are  the  detectors  which  are 
illuminated.  As  can  be  seen,  each  footprint  contains  two  rows, 
sometimes  three  rows  of  "1,"  while  there  can  be  as  many  as  8  columns 
of  "1."  It  is,  of  course,  known  that  the  output  aperture  of  each 
light  horn  is  circular.  The  distortion  experienced  is  a  consequence 
of  the  way  the  detectors  are  oriented  on  the  chip.  Of  course,  once 
this  is  known,  allowance  could  be  made  in  the  software  to  correct  this 
distortion.  However,  since  the  MAO  device  is  not  intended  as  a  camera 


which  produces  an  image  for  a  human  observer,  but  as  a  device  which 
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Figure  16.  Binary 

Image  of 
Fig.  15. 
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recognizes  an  object  and  reports  the  recognition,  any  distortion,  as 
long  as  it  is  consistent,  is  of  no  consequence.  However,  during  the 
research  program  we  need  to  monitor  what  the  device  sees  and  for  this 
reason,  we  are  displaying  these  images  on  the  monitor.  Therefore, 
when  viewing  these  images,  one  should  realize  that  this  distortion 
exists  and  should  make  allowance  for  it. 

Figure  17  again  shows  a  "plus"  sign  (white  on  black  background), 
this  time  correctly  exposed.  The  two  bars,  horizontal  and  vertical, 
should  be  the  same  width,  but  as  can  be  seen  the  horizontal  bar  is 
about  3  times  wider  than  the  vertical  bar.  If  one  considers  that  the 
typical  footprint  shown  in  the  binary  image  consists  of  2.25  rows  and 
7  columns,  about  a  1  to  3  ratio,  one  can  explain  the  distortion. 

The  same  effect  can  be  seen  when  a  rectangle  having  sharp  edges 
(Fig.  18)  is  displayed  (this  time  black  on  white  background).  The 
vertical  edges  are  much  better  defined  than  the  horizontal  edge.  The 
vertical  boundry  is  sensed  by  8  detectors,  up  and  down  is  determined 
by  an  average  of  2.25  detectors. 

Along  the  same  lines;  the  image  of  a  sharp  point  is  shown  in 
Figure  19  (black  on  white  background).  The  point  is  clipped  for  the 
same  reason,  also  the  edges  show  a  structure  which  is  a  consequence  of 
the  unequal  number  of  detectors.  Finally  in  Figure  20  an  extremely 
close  view  of  the  grid  lines  on  a  slide  containing  a  graph  is  given. 

Again  the  horizontal  lines  appear  wider  and  less  defined  than  the 
vertical  lines.  A  printout  of  the  binary  image  shows  (Figure  21) 
about  the  same  appearance.  However,  having  the  binary  image  avail¬ 
able,  there  is  no  doubt  where  the  real  lines  and  their  intersections 


are.  A  simple  algorithm  could  be  written  to  remove  the  excess  "1"  and 
leave  only  one  line  of  "1"  standing,  giving  a  perfect  image,  although 
the  acquired  image  was  distorted.  This  requires  a-priori  knowledge 
that  the  grid  system  is  indeed  continuous  so  that  it  can  be  assumed 
that  the  occasional  "0"  interrupting  the  lines  is  caused  by  noise  or 
damaged  detectors,  rather  than  by  an  imperfect  original.  However, 
such  assumptions  are  even  made  by  the  human  recognition  system.  It's 
tendency  to  fill  out  apparent  gaps  in  lines  is  well  known. 


8.  PATTERN  RECOGNITION  PROCEDURE 

A.  Concept 

As  pointed  out  before,  the  MAO  device  is  not  intended  to  be  a 
camera  producing  an  image  that  would  be  viewed  by  a  human  observer. 
Rather,  it  is  a  digital  device  capable  of  recognizing  a  pattern, 
whereby  the  necessary  circuitry  and  ROM  should  be  on  the  same  chip 
which  houses  the  MAO  mask.  In  the  following  we  are  simulating  this 
circuitry  on  a  PC,  which  is  the  reason  why  we  can  also  display  the 
images  that  the  device  "sees." 

The  concept  of  the  pattern  recognition  scheme  used  at  present  is 
based  on  the  fact  that  a  MAO  device  will  necessarily  present  a  small 
number  of  pixels.  The  optical  design  of  the  mask  has  to  be  aimed  at 
producing  pixels  on  optimum  locations  and  the  pattern  recognition 
scheme  has  to  try  to  make  the  best  out  of  the  information  presented. 

This  is  accomplished  by  not  expecting  to  find  and  not  accepting 
if  offered  unnecessary  details.  Therefore,  the  concepts  of  the  recog¬ 
nition  scheme  consist  of  assumming  that  any  pattern  encountered  con¬ 
sists  only  of  a  sequence  of  rectangles.  The  picture  language  used  has 
only  one  word  "rectangle.”  The  information  describing  the  object 
therefore  consists  of 

1.  Number  of  rectangles  contained  in  the  pattern. 

2.  Aspect  ratio  on  each  rectangle. 

3.  Orientation  of  the  rectangle  (meaning  the  longer  side  points 
either  in  the  x  or  y  direction). 


Therefore,  an  encountered  pattern  will  be  disected  into  an  assembly  of 
rectangles.  The  procedure  for  disection  is  held  flexible  and  is  at 
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present  subject  to  operator  input.  After  a  pattern  of  several  rec¬ 
tangles  is  established,  their  aspect  ratios  are  computed.  This  re¬ 
sults  in  a  set  of  numbers  which  is  the  ID  number  of  the  pattern  to  be 
recognized.  The  memory  contains  a  catalog  of  ID  numbers  of  objects  of 
interest.  An  attempt  for  a  match  can  be  made  against  these  stored  ID 
numbers . 

B.  The  Algorithm 

The  information  is  available  as  a  binary  image.  For  the  present 
it  is  assumed  that  each  "footprint"  represents  one  pixel  of  the  image 
received.  At  a  later  date  more  information  than  this  will  be 
recovered  from  the  content  of  one  footprint.  However,  for  the  time 
being  the  only  information  used  will  be  whether  the  pixel  is  present 
or  not. 

For  the  algorithm  used  it  is  assumed  that  each  footprint  can  con¬ 
tain  3x3  detectors.  At  the  images  presented  above  actually  only  2  x 
3  detectors  are  used,  however,  examining  Figure  14,  one  can  see  that  a 
3x3  matrix  could  indeed  be  established  by  readdressing  the  detector 
chip.  Since  the  chip  is  a  RAM,  this  is  indeed  possible. 

For  the  first  step  in  the  recognition  scheme  a  decision  has  to  be 
made  which  pixel  is  considered  to  be  present  and  which  to  be  absent. 
Therefore,  for  a  pixel  to  be  present  one  requires  that  a  footprint  has 
to  contain  a  minimum  number  of  "1."  The  program  leaves  it  up  to  the 
operator  to  decide  how  many  "1”  are  required,  although  in  a  future 
version  this  number  may  be  picked  by  a  trial  and  error  method.  How¬ 
ever,  at  present  the  operator  can  specify  1  through  9. 

For  easier  visualization  of  the  functioning  of  the  program,  a  set 
of  synthetic  data  is  presented  in  the  following  figures.  Figure  22 
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Figure  24, 


All  Foot¬ 
prints  Filled  ,«.> 
With  9  Binary  > 
Ones . 


shows  an  airplane-like  structure  in  the  form  of  a  binary  image.  An 
overlay  of  the  hole  pattern  is  given  in  Figure  23. 

As  can  be  seen,  there  are  some  footprints  which  contain  one  bi¬ 
nary  "l",  while  there  are  others  which  contain  six  or  three.  The 
operator  now  requires  that  6  binary  ones  are  adequate  for  a  pixel  to 
be  present.  After  this  input  is  made,  all  the  footprints  which  quali¬ 
fy  are  filled  up  with  9  binary  ones.  This  is  depicted  in  Figure  24. 
The  next  step  is  to  divide  all  positions  by  3,  which  generates  the  map 
in  Figure  25. 

The  next  step  is  to  enter  a  procedure  to  disect  the  so  reduced 
pattern  into  a  set  of  rectangles.  To  demonstrate  the  procedure  we 
pick  an  arbitrary  pattern  shown  in  Figure  26.  We  treat  each  line  as  a 
line  of  the  rectangle  to  be  formed.  Therefore,  we  are  only  interested 
in  the  boundary  of  the  lines,  and  not  whether  the  line  is  filled  or 
not.  With  this  we  find  the  first  line  to  be  8  units  long  and  the 
second  10  units,  etc.  The  operator  now  chooses  a  number  which  we  call 
"section  delimiter”.  The  procedure  consists  of  determining  if  the 
line  following  the  present  line  is  larger  than  the  "section  limiter." 
If  "no,"  this  next  line  will  be  part  of  the  present  rectangle.  If 
"yes,"  a  new  rectangle  will  be  started.  Therefore,  if  we  chose  ”5" 
for  the  section  delimiter,  map  A  in  Figure  27  would  result,  namely  one 
big  rectangle,  since  all  the  adjacent  lines  differ  by  not  more  than  5. 
However,  if  "3"  is  chosen  for  the  section  delimiter,  the  map  B  in 
Figure  27  would  result.  The  first  rectangle  consists  of  lines  1-3 
which  all  differ  less  than  ”3",  while  line  number  4  differs  from  line 
number  3  by  more  than  "3."  Line  number  4  also  differs  from  line 
number  5  by  more  than  "3."  Therefore  line  5  again  starts  a  new 
rectangle,  making  it  3  rectangles  altogether. 
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Figure  26.  Arbitrary  Pattern. 
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Figure  27.  Alternate  Interpretations  of  Fig.  26 
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PERFORMANCE  OF  THE  RECOGNITION  PROGRAM 


The  performance  of  Che  above  described  recognition  program  was 
tested  first  with  synthetic  data  and  then  with  an  actually  acquired 
image.  The  shape  used  for  the  synthetic  data  is  shown  in  Figure  29. 

It  is  a  binary  image  of  an  airplane-like  structure.  The  print-out  "0’’ 
indicating  unilluminated  detectors  was  suppressed  for  the  sake  of 
clarity. 

To  these  data  some  noise  was  added  inside  the  pattern,  which  may 
simulate  damaged  detectors  or  underexposed  detectors.  The  pattern  with 
noise  is  shown  in  Figure  30.  The  program  was  able  to  recognize  the 
pattern.  Considering  the  way  the  recognition  scheme  works,  this  is  not 
surprising.  Since  it  checks  for  boundaries  only,  in  effect,  it  con¬ 
verts  everything  to  a  shadowgraph.  Missing  elements  inside  a  pattern 
are  of  no  consequence. 

Therefore,  now  noise  was  added  to  the  outside  of  the  pattern, 
leaving  the  pattern  for  the  time  being  alone.  This  can  be  seen  in 
Figure  31.  Again,  the  system  was  able  to  recognize  the  pattern.  This 
noise  may  simulate  either  detector  noise  or  background  illumination. 

If  detector  noise  is  simulated  the  situation  is  more  favorable.  The 
system,  of  course,  "knows”  where  the  footprints  are.  Therefore,  to 
accept  reports  from  detectors  under  void  spaces  would  be  only  meaning¬ 
ful  if  the  neighboring  footprint  had  all  3x3  detectors  illuminated. 

If  this  is  not  the  case,  signals  coming  from  detectors  under  void 
spaces  should  be  ignored.  As  far  as  signals  in  the  footprints  them 


Figure  29.  Synthetic  Data. 
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selves  are  concerned,  the  number  of  "1“  to  be  present  can  be  set  by  the 

operator.  However,  there  is  also  the  side  condition  that  irregardless 

of  how  many  “1"  are  required  the  center  detector  of  the  footprint  has 
to  be  one  of  the  required  ”1.” 

A  setting  of  5  seems  to  be  a  reasonable  choice.  Therefore,  scan¬ 
ning  Figure  31  for  a  ”1"  which  is  surrounded  by  at  least  4  other  "1", 
it  can  be  seen  that  there  are  only  a  few  candidates.  For  these  the 

additional  condition  that  they  are  indeed  the  center  of  a  footprint  has 

to  be  fulfilled  before  a  pixel  is  generated.  This  reduces  the  number 
of  candidates  even  more.  Therefore,  it  is  not  surprising  that  the 
system  was  able  to  recognize  the  pattern. 

However,  if  the  noise  in  Figure  31  was  random  background  fluctua¬ 
tion  rather  than  detector  noise,  the  centers  of  the  footprints  would  be 
preferably  illuminated,  since  it  is  a  real  signal  which  is  received. 

The  system  would  have  to  treat  these  pixels  as  a  part  of  the  pattern, 
and,  of  course,  could  not  recognize  it.  If  a  situation  like  this 
exists,  a  cure  can  be  found  by  requiring  at  least  3  pixels  per  line 
(instead  of  one,  as  described  above)  to  form  a  line  belonging  to  a 
rectangle.  This  makes  the  system  less  sensitive  but  less  prone  to  not 
recognize  a  known  pattern.  The  sensitivity  can  be  restored  to  some 
degree  by  requiring  only  four  ”1"  instead  of  the  5  or  6  as  done  above. 

Both  types  of  situations,  namely  as  shown  in  Figure  30  and  31,  are 
superimposed  in  Figure  32.  The  target  is  now  already  marginal.  Of 
course,  the  system  will  recognize  it  for  the  reasons  explained  already, 
since  nothing  has  changed.  Figure  33,  however,  is  too  noisy  for  the 
system  to  recognize,  while  the  human  system  still  recognizes  albeit 
only  if  it  knows  what  to  look  for. 
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Figure  30.  Noise  Added  to  Fig.  29 


U 


tl 

III 


min 
m 
in 

till 

ii 


in 


n 
it 

inn 

in 

n  i 


mini 

n 

nun 

nn  in 

in  in  n 

nn  in  in 
n  n  in 
n  n 

nun  nun! 
nntn 

n  in 

nnn 
nn  in 

nn  n  in  in 

n  n 

inn  nnn  nnni 

in  ntnn 

n  nnn  n  n 

in  nnn 

in  nn  in 

nn  in  in  nn 

n  nn  in  in 

inn  n  n  in 


nn 

nn 

n  n 

in 

n 

ii 

in 

n  nn 

n 

n 

mi 

n 

mn 

n 

in 

it 

mn 

i 

in 

nn 

mn 

in 

n 

i 

i 

i 

in 

i  ti 

n 

n 

m 

in 

inn 

in 

n  i 

inn 

i 

in 

i 

n  n  n 

inn  nnn  innin 

in  nnninn 

n  min  niinn 

in  innin 

in  nnninn 

nn  in  nnnn 
n  nn  nnnn 


n 


in 

n 


inn 


n 

in 


inn 


n 


n 


mtnn 


nnnnnnnnnnnmnn 

mnnnnnnnnnnnnn 


nnnnnnnnnnnmnn 

iiiiiiiiitiiiiiiiiiiiiiiiiin 


nnnnnmnnmimmn 

mnnnnnnnnntnmn 


nnnnnnnnnnnmnn 

nnnmnnnnnnnnnn 


in 

n 


iiimnin 
nnnn 


min 

m  liiinii 

in  nnninn 

nn  in  nnnn 
n  nn  innin 

inn  n  nnnn 

n  n  nnnn 

in  nnninn 

nn  in  mum 
n  nn  innin 

inn  n  ilium 


n 


n 

in 


in 

n 


nn 


in 


m 

n 

in 

n 


nnn 

in 

in 

nn  in 


nnn 


nnn 
m 
in 

nn  in 
n 

inn 
n  n 


nn 

n 


liiinii 

nnninn 

minimi 

innin 

innin 

minimi 

mum 

nnninn 

innin 

minimi 

nnnn 

tnmn 

nnninn 

liiinii 
mini 


n 


nn  nnnn  nn  inn 
mnnnnnnmm 
n  nnn  min  ntnn 
n  nmnnnnmnm 
i  nnnnnnnnnm 

i  n  mmnnnnmnn 
n  nnnnnnnnnm 
mnnnnnnmm 
in  nnnmnnnnnn 
n  nnnnnnnnnm 
n  n 

in  in 

n  mm  in 

m  n  nnn 
inn  in 

m  n  i 

nn  nn 

in  in 

n  n  n  n  n 


nil 


n 


in 


nnninn 

nnnnt 

niiinn 

miinii 

niiinn 

tmnin 


in 


in 
in 
i 

nnn 
in 

in  in 

nn  in 
n  nn 

mu  n 

iininim  n 

nnttni  in  in 

nnnnt  n 

nnnnmnnnnnimmm 
nnnnnnnnnnnnmnn 

nnnnnnnnnnnninnn 

nnnnnmnnnnnnnnn 
nnnnnnnnnnnninnn 
nnnnnnnnnnnmnnn 
nnnnnnnnnnnmnnn 
nnnnmmnnnmnnnn 
itmimnn  in 

nniimin  nnn 

nnnnn  in 

nnnnii  in  in 

nnnnn  nn  in 

minim  n  nn 

nnnnn  tint  n 

miiimm  n 

nnnnn  n  nn 

nnnnnni  in 

nnnnnn  nnn 

nnnnn  in 

nnnnn  in  in 

nnnnn  nn  in 

ninimnn  in 

nnnnnn  mm 

minim  in 

niinnit  m  in 

niiinni  nn  in 

niiniinin  in 

nnnnnn  min 

nnnnn  in 

minim  in  in 

nnnnn  nn  in 

minim  n  nn 

nnnnn  inn  n 

nnnnnn  n 

nnnnn  nn  in 

nnnnn  it  nn 

iiimini  mu  n 

nnnnnn  n 

nnnnnnnnnnn 
nnnnnntnnmn 
nnnnnnnnnnn 
nnnnnmnmnn 
nnnnnnnnnnn 
mtnnnnmnmn 
nnnnnnnnnnn 
mnnnnnmnnn 
nnnnnnnnnnn 
nnnnmnnmnn 
in  in 

nnn 


mm 


m 

in 


n 

n 


in 


m 


nn 

n 


n 


in 


in 

mi 


inn 


nn 

inn 


in 

i 


in 

n  in 

m 


nnn 

ti 

i 


nn 


n 

inn 


n 


nnn 
in 
in 

nn  in 

in  nn 

n  n 


n 


nnnn 

n 

m  i 


in 
n 
in 
n 

inn  in 
in  inn 
n  nm 
in 
in 

mi  m 


i 

n 

nn 

in 

n 

in 

i 

in 

in 

n 

in 

t 

n 

mi 

n 

n 

n  i 

n 

n 

n 

i 

m 

i 

i  nn 

in 

in 

n 


m 


n 

mn 

n 

n 


« • 


“,r 

m 

in 


i  ii 

i  inn  i 

n 

mm 
n 

nnn  a 

nn  in 

in  nn 


m 

in 

nn 

in 

n  n 


m 


nn 

it 


m 

i 


i 

in 

it 


in 


it 

n 


in 

in 


Figure  31.  Outside  Noise  Added 
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Figure  32.  Combination  of  Fig.  30  and  Fig.  31 
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Figure  33.  Noise  Too  Excessive  for  Recognition 
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The  recognition  system  was  next  employed  to  work  on  data  taken  by 
the  experimental  device.  Figure  34  shows  the  binary  image  of  an 
airplane-like  structure  as  produced  by  the  experimental  device.  The 
following  sequence  of  figures  shows  first  an  unsuccessful  attempt  to 
recognize  the  acquired  shape  and  then  a  successful  one.  The  difference 
between  the  two  is  the  selection  of  the  value  of  the  section  delimiter. 

The  reduction  of  Figure  34  into  footprints  is  shown  in  Figure  35. 
It  was  obtained  by  requiring  at  least  7  detectors  to  be  illuminated  in 
each  footprint.  Those  which  qualified  were  artificially  filled  with  9 
binary  "1."  The  coarse  map  derived  from  Figure  35  is  shown  in  Figure 
36.  Then  the  section  delimiter  was  set  to  “5"  which  produced  the  set 
of  rectangles  shown  in  Figure  37.  The  system  was  not  successful  in 
recognizing  this  set  as  a  known  pattern. 

Resetting  the  section  delimiter  to  ”7"  produces  a  different  set  of 
rectangles  which  is  shown  in  Figure  38.  The  system  recognized  this 
shape  as  an  airplane. 

Since  there  is  such  a  stringent  limitation  in  the  number  of  pixels 
available  the  system  is  very  sensitive  to  rotation  of  the  object.  The 
recognition  procedure  has  to  be  improved  to  allow  an  acquired  pattern 
to  be  rotated  until  recognition  is  achieved. 


ATFILEb  PLANE . DAT 
PABFILEa  PLANE - PAR 

To  #n#lyi»  •  prtvipti*ly  cr««t«d  C  3. 
To  #n«lvi«  m  n»w  C  3 • DAT  f ll«i  ■ntsi 
1 

reading  In  th«  data ,  .  . 


Would  you  Ilka  to  aaa  th« 


PA6  f  Uti  antar 


oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

0000000000000000000000000000000900000000000000000000000000000000 

.  OOOOOOOOOOOOOOOOOOOOOOOOOOOOCOOO 1 111111111111121 1 ooooooooooooooo 
■Hj  OOOOOOOOOOOOOOOOOOOOOOOOOOOOO  1111111111111111111111  ooooooooooooo 

■P  OOOOOOOOOOOOOOOOOOOOOOOOOO 1  111111111111121111111111111  OOOOOQOOOC* 
■J  OOOOOOOOOOOnOOOOOOOOOOOO 11111111111111111111111111111111 1 ooooooo 
OOOOOOO  OOOOOOOOOOOOOOO  1  1111111111111111111111111111311111  1  OOOOOO 
OOOOOOOOOOOOOOOOOOOOOO 11111111111111111111111111111111111111 oooo 
OOOOOOOOOOOOOOOOOOOOOO 11111111111111111111111111111111111111 OOOO 

4  OOOOOOOOOOOOOOOOOOOOOl 111111111211111111111111111111111111111 ooo 
p J  OOOOOOOOOOOOOOOOOOOOO 11111111111111111111111111111111111111111 oo 
OOOOOOOOOOOOOOOOOOOO llllllllllllllllllllllllllllllllllllllllllll 
OOOOOOOOOOOOOOOOOOOO  llllllllllllllllllllllllllllllllllllllllllll 
OOOOOOOOOOOOOOOOOOOO 11111111111111111111111111111311111111111111 
OOOOOOOOOOOOOOOOOO 1111111111111111111111111111111111111111111111 
OOOOOOOOOOOOOOO 1111111111111111111111111111111111111111111111121 

^  oooooooooooo 1111111111111111111111111111111111111111111112111111 

OOOOOO 1111111111111111111111111111111111111111111111111111113111 
OOO  1111111111111111111111111111111111111111111111111111111111111 
'•  •  0111111111111111111111111111111111111111111111111111111111311111 

1131111111111111111111111111111111111111111111111111111211111111 
1111111111111111111113111111111111111111111111111111111111111111 
3111111111111111111111111111121111111111111111111111111111111111 

V  1111111111111111111111111111111111111111211111111111111111121111 

1111111111111111111111111111111111111111113  211111111111211111111 
1111311131111111111111111111111111111111111111111111111111111111 
1111111111111111111111111111111111111111111111111111111111111111 
111111211111111111111111111111111111112111111111111111111112  OOOO 
1111111111111111113112111111111111111111111111111111 OOOOOOOOOOOO 
111111111011111111111111111111111111121111111111 OOOOOOOOOO OOOOOO 
OOOOOOOOOOOOOOO OOOO 1111111111111111121111112111 OOOOOOOOOOOOOOOOO 

*  *.  OOOOOOOOOOOOOOOOOOOOO  1  111111111111111111111111  1  OOOOOOOOOOOOOOOOO 
.*„*  OOOOOOOOOOOOOOOOOOOOOO J  11111111111111111111111  1 OOOOOOOOOOOOOOOOO 

OOOOOOOOOOOOOOOOOOOOOO! 11111111111211111111111 1 OOOOOOOOOOOOOOOOO 
OOOOOO OOOOOOOOOOOOOOOOO 1 11111111111111111111111 OOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOO 1111111111111111111111 OOOOOOOOOOOOOOOOOO 

*  OOOOOOOOOOOOOOOOOOOOOOOO  1  11111111111111111111  1  OOOOOOOOOOOOOOOOOO 
OOOOOOOOOO  OOOOOOOOOOOOOOO  l  11111111111111111  l  OOOOOOOOOOOOOOOOOOOO 

p  l)0<  ‘OOOOOOOOOOOOOOOOOOOOOO  1  11111111111111111  1  OOOOOOOOOOOOOOOOOOOO 
Mkm  OOOOOOOOOOOOOOOOOOOOOOOOOO!  111111111111111111  1  OOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOO 1  1  11111111111111111  1 OOOOOOOOOOOOOOOOOO 
0000000001*0000000000000000 1111  11111111111  11111 OOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOoOOOOOOOOOOOOOl llllllllllllllllllllll OOOO OOOOOO OOOOOO 
.  OOOOOOOOOOOOOOOOOOOOOOOO 1111111111111311111111111 ooooooooooooooo 
V  OOOOOOOOOOOOOOOOOOOOOOOl 1111111111111111111111111111 1 O OOOOOOOOOO 

-  .  OOOOOOOOOOOO OOOOOOO 111111111111111111111111111113111111 OOO OOOOOO 
«*  OOOO*  ‘OOOOOOOOOOOO  1  11)1111131111111111111111211111111131  OOO  OOOOOO 

OOOOOOOOOOOOOOOOO 1  11111111111111111111111111111111111111  I OOOOOOO 
OOOOOOOOOOOOOOOOO 11113111111111111111111111111111111111111 OOOOOO 
.  OOOOOOOOOOOOOOOOOO  1  111111  111111111111  11111  11111111111111131  100*30 

■  OOOOOOOOOOOOOOOOOO 11111111111111111111111111111131111111111 lOOOO 

■  OOOOOOOOOOOOOOOOOOOO  111111111111111111111111111111113111111  001.100 

™  0*»00000or»000000000000l  1111111J1131  311111111111111112111  lOOOOOOOO 

~  OOOOOOOOOO*  lOOMOOOnoOOO  1  11111111  i  ooc»ooooooooooooooooooo«.»ooooooooo 

0000000000000000000000000000000000000000000000000000000000000000 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
.  T  OOOOOOOOOO*.*  OOOOOO  OOOO  OOO  OOOOOOOOOO  OOO  OOOOOOO  OOOOOOOOOOOOOOOOOOOO 

,  v  ooooooo«,>ooooooooooooooooooooooooooooooooooooooooooooooooooooo*x:k* 

O0r>000000000000c»00000*^0000000000000000000000000 OOOOOOOOOOOOOOOOO 

*-  .  OO000000000000000000000000000000000000000000000 OOOOOOOOOO ooooooo 

OOO OOOOOOOOOOOO OOOOOOO OOOOOO OOO OOO OOOOOOOOOO OOOO OOOOOO OOO OOOOOOO 

ooo oooo oooooooooooooooooooooooooooooooooooo oooo ooooooooooooo  oooo 
oooooooooooooooooooooooooooooooooooooooooooooooo ooo ooooooooooooo 
pi  ooooooo ooooooooooooooooooooooooooooooooooooooooooooooooooooooooc* 

■ *  oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

*  .  ooooooooooooooooooooooooooooocoooooooooooooooooooooooooooooooooo 

■  OOO OOOOOOOOOOOOOOOOOO OOO OOO OOOOOOOOOOOOOOO OOOOOOOOOOOOOOOOOOOOOO 

0000r»o0000000000000000000000000000000000000000r»000000000000000*:»c* 

OOOoOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
•*.  OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOr*  OOOOOOOOOOOOOOOOOOOOOO  OOOOOO 
0c»0000000<"»  OOOOOO  0**00  OOOOOO 00000*1*00  OOOOOOOOOO  OOOOOOOOOOOOOOOOOOOO 

•y  oor»ooooooor.ooo«-*oooooooooooooooooooooc»oooooooooooooooooooooooooo«.* 

— *  0000**00 OOOOOOOOOOOO OOOOOOO OOOOOOOOOOOO OOOOOOOOOOOOOOOOOOOOOOOOOO 
0000000000000000000000000«'»00000000000000000000000000000*  *00000000 
oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

OOOOOOOOOOOO OOOO OOOOOOOOOOOOOOOOOOOOOOOOOO OOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOO OOOOOOOOOOOO OOOOOOOOOO OOOOOO OOOOOO OOOOOOOOOOOOOOOOO 

*  OOOOOOOOOOOOOOOOOOOOOO*  ‘OOOOOOOOOOOOOOOOOOOOOOOOOOOOO OOOOOOOO OOOC* 

.  _  0**0000 OOOOOO OOOOOO OOOO OOOOOOOOOOOOOOO OOOO OOOOOOOOOOOOOOO OOOO OOOO 

ooo ooo o**oo oooooooooo oooooooooooooooooooo on ooooooooooooooo oooo ooo 
ooooooo  oo  *>0000000000  **  ooo  oooooo  oooooo  ooooooooonooo  oooo  ooo  ooooooo** 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO** 

-  .  OOOOOO  OOOOOOOOOOOOOOOOOOOOOOOO  OOOOOO  OOOOOOOOOOOOOOOOOOOOOOOOOO*.*** 

*  ooo  oooooo  oooooooooooo  oooo  ooo  ooooooooooooooo*.*  oooooooooooooooooooo 

-  *  OOOOOOOOOOOOOOOOOOOOO OOOO OOOOOOOOOOOOOOOOOOOOOO OOOOOOOOOOOOOOOOO 
I,  OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

OOOOOOOOOOOOOOOOOO OOOOOOOOOOOO OOOOOOOOOOOOOOOOOOOOOOOO OOOOOOO OOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 

•  OOOOOOOOOOOOOOOOOOOOOOOOOO  OOOOOOOOOOOO  OOOOOO  OOOOOO  oooooooooooooc* 
^  OOOOOOOOOOOOOOOOOOOOOOO OOOOOOOOOOOO OOOOOOOOOOOO OOOOOOOOOOOOOOOOO 

*  *  OOOOOOOOOOOOOOOOOOOOOOO  OOOO  OOOO  OOOOOOOOOOOOOOOOOOOOOOO  OOOOOOO  0‘^<* 

ooc»oooooooooooooooc*oor>oooooo  oooooooooooooooooooo  oooc*oooooooo*:>ooo 
OOOOOOOOOOOOOOOOOOOOOOOOOO oooooooooooooooooooooooooooooooooooooo 

%  ooooooo OOOOOOOOOOOOOOOOOOOOOQOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
oOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO OOOOOOOOOOOOOOOOOO OOOOOOOOOOOOOOO 
I  OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO OOOOOOOOOO 
L  OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOC* 

*  OOOOOOOOOOOOOQOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
0000000000000000000000000000000000000000000000000000000000000**00 
0000000000000000000000000*^000000000000000000000*30000000000000000 

:  ,*  00000000000000000000000000000000000000000000000000000000000000*30 

^ k  oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 
oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 
^  oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 
oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 
oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 
oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

P  OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO OOOOOOOOOOOO 0000*^000000000000 
0000000000000000000000000000000000**0000000000000*^000000000000000 
7^  ooo ooo or*  ooooooo oooooooooooooooooooooo oooooooooo non ooo ooooooo noon 

.%  ooooo*.»oooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

OOOOOOOOOOOOOOOOOOOOOOO  OOOOOOOOOOOOOOOOOOOOOOOOOO*^ 0**00000 ooo  o«>oo 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 

L ** a  ^ %  •**  ^ ^ 4.A  **«  J*.  •*»  ,  •'  »*“.  ,  n".  .*  *•“  *•'  »*  -*  - '  «’  _  ,k 


Figure  34. 


Airplane-like 
Structure  as 
Acquired  by 
MAO  Device. 


To  attempt  ra 
To  attampt  ra 


ogni t  1  on 
oqrtl  t;  too 


Value  for  piMal  c 
*7 

Vo  1  cio  Tor  aactlor 


mi th  a  ear  lap  oT  toggle  ana  tnr»»n c id  vaiuai 
mi th  a  alngla  combination  ©T  those  vaiuaa>  a 


•  *  enter  *  1 
inter  'C' 


■\/oTT  to«gl*T  — 


dl vi dar T — 


lyalat  patt#rn?-’v* 


Mould  you  like  to  tea  this  ayalat  pattern?- • v ' 

V 

OOOOOOOOODDOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOnOOOOOOOOOOODD 
QOOOOQOOOOOOOOOOOOOOOOOOOOOOOOOOOOODOOOOOOOOOOOOOOOQODOODOOODOOO 
OODOOOOOOOOOOOOOOOOOOODOOOOOOOOOO 111 OOOOODDOOOOOQOOOOOOOODOOOOOO 
OOOOODOOOOOOOOOOOOOOOOOOOOOOOOOOO 111 OOOOOOOQ 111 OOOOOOODOODOODOOO 
OOOOOOOOOOOOODOOOOOOOOOOOODOOODOOl 1 lOOOOOOOOl 1 1 OOOOOOOOOODOOOOOD 
OOOOOOOOOOOOOOOOOOOOOOOOOO 1 1 lOOOOOOOOOOOOOOOl 1 lOOOOOOOOOOOOOOOOD 
OOOOOOOOOOOOOOOOOOOOOOOOOO 1 1 lOOOOOOOOl 1 1 OOOOOOOOOQOOOOOOOQOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOO 111 OOOOOOOO 111 OOOOOOOO 111 OOOOOOOOOOOOO 
OODOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 1 OOOOOOOl 1 1QOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOl 1 1 OOOOOOOOOOOOOOOO 1 1 1 OOOOOOOl 1 lOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 lOOOOOOOOOOOOOOOl 1 lOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 lOOOOOOOOl 1 lOOOOOOOOOO 
OODOOOOOOOOOOOOOOOOOOOO 1 1 lOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 1 OOOOOOOl 1 1 
OOOOOOOOOOOOOOOOOOOOOOO 1  1  lOOOOOOl  1  1 OOOOOOOOOOOOOOOO 1  1  1 OOOOOOOl  1  I 
OODOOOOOOOOOOOOOOOOOOOO 1 1 lOOOOOOl 1 lOOOOOOOOOl 1 lOOOOOOOOOOOOOOl 1 1 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOl 1 lOOOOOOOOOl 1 lOOOOOOl 1 1 OOOOOOOO 
OOOOOOOOOOOOOOO 1 1 lOOOOOOOOl 1 lOOOOOOOOOOOOOOOl 1 lOOOOOOl 1 1 OOOOOOOO 
OOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 1 OOOOOOOl 1 lOOOOOOOOOOOOOOl 1 1 OOOOOOOO 
OOOOOOOOOOOOOOO 1 1 lOOOOOOOOl 1 1 OOOOOOOl 1 lOOOOOOOOl 1 1 OOOOOOOOOOOODO 
OOOOOOOO 1 1 lOOOOOOOOOOOOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 lOOOOOOOOl 1 lOOO 
OOOOOOOO 1 1 1 OOOOOOOl 1 lOOOOOOOOl 1 lOOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 lOOO 
OOOOOOOO 1 1 1 OOOOOOOl 1 lOOOOOOOOl 1 1 OOOOOOOl 1 1 OOOOOOOOOOOOOOOO 1 1 lOOO 
11 lOOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 1 OOOOOOOl 1 1000000003 1 lOOOOOOOOOOO 
1 1 lOOOOOOOOl 1 lOOOOOOOOOOOOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 lOOOOOOOOl l 1 
11 lOOOOOOOOl 1 lOOOOOOOOl 1 lOOOOOOOOOOOOOOOOOOOOOOOOOl 1 1 OOOOOOOO 1 3 1 
OOOOOOOOOOOl 1 lOOOOOOOOl 1 lOOOOOOOOl l lOOOOOOOOOOOOOOOOOOOOOOOOOl 1 1 
OOOOl 1 lOOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 lOOOOOOOOl 1 1 ooooooooooooooooo 
OOOOl 1 lOOOOOOOOl 1 lOOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 1 ooooooooooooooooo 
OOOOl 1 lOOOOOOOOl 1 lOOOOOOOOl 1 lOOOOOOOOOOOOOOOl 1 1 ooooooooooooooooo 
OOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 lOOOOOOOOl 1 1 OOOOOOOOOOQDOOOOOOOOODOO 
OOOOOOOOOOOOOOOOOOOOOOOOOO 1 1 lOOOOOOOOl 1 1 OOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO lit  OOOOOOOOOOOOOOOOOOOOOOOO 

00000000000000000000000000000 111 oaoooooooooooooooooooooooooooooo 

OOOOOOOOOOOOOOOOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 1 ooooooooooaooaooooooo 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOl 1 lOOOOOOOOl 1 1 ooooooooooooooooooooo 
ooooooaooooooooooooooaoaoooooooooooooaoo i i i ooooooooooooooooooooo 
oaciooooooooooooooooaoaooooooooooo  m oooooooooooooooooooooooooooo 
oooooaoooooooooooaooooooooooooooo 1 1 1 oooooooooooooooooooooooooooo 
oooooaooooooaoooaooooaoaaoooooooo in oooooooooooooooooooooooooooo 
OOOOOOOOOOOOOOOOOOOOOOOOOO 111 ooooooooooooooooooooooooooooooooooo 
OOOOOOOOOOOOOOOOOOOOOOOOOO 1 1 lOOOOOOOOl 1 1 OOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOO 1 1 1000000003 1 1 OOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOQOOOOOOOOOOOOOOOOOOOOOOOOOOOO 111 OOOOOOOOOOOOOOOOOOOOOOOO 

oooooaooooooooooooooooooooooo 111 ooooooooooooooooooooooooooaooooo 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOl 1 lOOOOOOOOOl 1 i oooaoooooooooooooooo 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOl 1 lOOOOOOOOOl 1 lOOOOOOOOl 1 1000000000 
OOOOOOOOOOOOOOOOOOOOOOl  I  I OOOOOOOOOOOOOOOO 1  1  lOOOOOOOOl  1  lOOOOOOOOO 
OOOOOOOOQOOOOOOOOOOOOQ 1 1 1 OOOOOOOl 1 1 OOOOOOOOOOOOOOOOO 1 1 lOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOl 1 1 OOOODOO 1 1 lOOOOOOOOOl 1 1 OOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOl 1 lOOOOOOOOOl 1 lOOOOOOOOl 1 lOOOOOO 

ooooooooooooooooooooooaooi i ioooooooooooooodoi i 1000000001 i looooon 

QOUOOOOOOOOOOOOOOOOOOOOOOl 1 1 QOOOOOOOOOOOOQODOOODDDODQDO 1 1 lOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOO 1 1 1 OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 

Dooooooaoooooooooooooooooooooooooooooooooooooooonoofioooooooooooo 

ooooooooaooooooooooaoooooooooooooooooooooooooooooooooooooooooooo 

OOOOOOOODOOOOOODOOOOOOOOOOODOOOOOOOOOOOODODOOOOOOOOOOOOOOOOOOOOO 

oooooooonoaooooooooaooaooooooooooooooooooooooooooooooooooooooooo 

ooooooorJOQOoouooooooaooooooooDoooooooooooaaooooooooooaooooooocioo 

OOOOOOOOOOODOOOOOOOOOOOOOOOOOOOOOOODOOOOOOOaODODDODOOOOOOOOODOOO 

oooooooaoooooooooooooooooooooocjoooooooooooooooooooooaoooooooaooo 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOODOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 

OOOOOOOOODOOOOOOOOOOOOOOOOOOOOOOOOOOOOUOOOOOOOOOOOOOOOOOOOOOOOOO 

OOOOOOODDOODOOOOOOOODOOOOOOOOOOOOODOOOOOOOOOOOOOoaOODOOOOOOOOOOO 

OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 

OODOOODOOOOOOnDOOOUDOOQOOOOOOOOOOOOOOOOOOOOODOODDDOOODDOOOOOOOOO 

oooooaoooooooooooooooooooaoooooooooooooooooooooooooooooooooooooo 

oooooooooooooooooooooooooooooooooooooooooooooaaooaooooooooooooao 

ooooooooooooooooooaooooooooooooooaooooooaoaouaooooooaoooaoooaooo 

ooooooooooooooooooooooooocioooooooooooooooooooooooooooooooooooooo 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooaooooao 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

oooooooooooooonoooooooooooooaooooooooooooooooooooooooooooooooooo 

ooooooooooooooooooooooooooooooooooooooooooaoooooooooooaooooooooo 

ooooooooononoooooooooooooooooooooonooooooooooooooooouooooooooooo 

oonooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

onooaooooooooooooooooooooooooooooooooooooooooooooooooooonooooooo 

OOOOOOnOOOOOOOOnOOOOOOOOOOOOOOOOOOOOOODOOOOOOOOOOOOOOOOOOOOOOOOO 
OOOOODOOOOOOODOOOOOOOOOOOOOOaaOOOOOOOOOOOOOOOOOOOOOOOOOOODOOOOOO 
ooonooooooooooooooooooooooooooooonooooooaoooooooooooooooaooooooo 
OOOOOOOOOOODOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOO OOOOOOOO OOOOOOOOOOOOOOOOO OOOOOaOOOOOOOOOOOODOOOOO 
0000000000000000000000000000000000000000000000000000000000000(300 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

oooooooooooooooooooooooooooooorjooooooooooooooooooooooooooooooooo 

ooooooooooooooouooooooooooooooooaooooooooooooooooooaoooooooooooo 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

oooooooooooooooooooooooooooooooooonooooooooooooooooooooooooooooo 

oooooooooooooooooooooooooooooooooooooooooooooooonooooooooooooooo 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 


ooooooooooooooooooooooooooooooooooooooooooooooooooooonoooooooooo 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

OQOOOOOOOOOODOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOODDDOOOOOOODOO 

OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 

OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 

OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOODOOOOOOOOODOOOOOODDOO 

OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOQOOOOOOOOOOOOOOOOOOOOOOOOOO 

OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 

OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOODOODODODOOOOOOOOOODODOOODDODOD 

OOOOOOOOOOOOOOOOOOOOOOODOOOOOOOOOOQOOOOOOOOOOOOOOOOOOOOOOUDOOOOO 

OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 

OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 

OOOOOOOOOOOOaOOOOOOOOOOOOOOOOOOOOOOOOOOODOOOOOOOOOOOUtJOOOOOOOOOO 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooaoooooo 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

OOOOOOOOOOOOOOOOOOOOOOOOODOOOOOOOOOOOOOOOOOODDOOODODOOOOOOOOODOO 

oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo 

DOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOUDDOOOOOOODOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOQOOOOOOQOO OOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOODOOOODOOOOOOOOOOOOOOUOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 
OOOOOOOOODOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO 


1 
4 


Figure  35. 


Reduction  of 
Fig.  34  to 
Footprints . 


3* 


JiOOOOOOOOOOOOOOOOOOOOOOCJOOOOOODpOpOOOOQOgaOOpDOQOOOODODOOOQOODDO  k  k 


Art*  lysis  at  p  1  ms  1  on/of  f  toggle  »  7 
and  aact  iortal  divider  ■  S 

The  X-SKit  faaturaa  ganaratad  are i 

3. SO  7.00  7.00  10.90  1^.00  X . 30 

Tha  V— axis  features  ganaratad  arai 
0.71  1 . 4»e  a  -  oo 

Would  you  Ilka  to  aaa  the  smoothed  pattern?— ’V 


i  i  i  t  ixixixixixtxix:  >  t  i  t  : 


i  i  i  <  ixixixixixixixi  :  i  t  i  i 


I  I  1  IXIXIXIXIXIXIXIXIXIXIXIXIXIX 


I  I  I  IXIXIXIXiXIXIXIXIXIXIXIXIXIX 


tXtXIXtXIXIXfXIXIXIXIXIXIXIXt  1  I 


IXIXIXIXIXIXIXIXIXIXIXIXiXIXI  t  I 


XiXIXiXIXIXIXIXIXIXIXIXIXIXIXIXIXIXIXIXIX 


XlXIXIXIXIXtXIXIXlXIXIXIXIXIXIXIXiXIXIXIX 


XIXIXIXIXIXtXIXIXIXIXIXIXIXI  I  I  I  I  I 


i  i  i  i  ixix:xixixixi  i  i  i  i  i  i 


i  :  i  i  ixixixixixixi  I  i  i  i  t  i 


I  i  i  I  ixixixtxixtxi  i  i  I  i  i  t 


I  I  I  I  IXIXIXIXIXIXI  1  I  I  I  I  t 


i  i  t  i  ixixixixixixi  i  i  i  i  i  t 


I  I  t  IXIXlXtXIXIXIXIXIXIXIXIXI  t 


I  I  IXIXlXtXIXIXIXIXIXIXIXIXI  t 


I  I  t  IXIXlXtXIXIXIXIXIXIXIXIXI  t 


‘  Figure  37. 

»  I  i  »  t  i  i  i  t  i  I  i  I  i  i  »  1  x 


A  .  OO 


Rectangles  Produced  from 
Fig.  36. 


> 


Analysis  *t  pixal  on/off  toggle  •  7 
•  r»  d  sectional  divider  —  7 

The  X-anie  fsaturss  generated  arei 

■. 43  14.00  l.eo  4.00 

The  V-aKis  features  generated  are • 

1  .07  1  .  <+t*  4.00 

AS  pixel  on/off  toggle  ■  7  and  divider  •  7»  the 
Would  you  like  So  see  Shis*  smoothed  pattern?  — 'Y 
V 

pat  S n  i  si 

•  type  1  p  X ane . 

IXIXIXIXIXIXI 

X  1 

X  1 

X  1 

X  1 

X 

1  X  1 

X 

1  X  1 

X  1 

x  1 

X  1  X  1 

X  1  X  1  X  1 

IXIXIXIXIXIXI 

X  1  X  1 

X  1 

X  1 

X 

1  X  1 

X 

1  X  1 

X  1 

x  1 

X  1  X  1 

X  1  X  1  X  t 

IXIXIXIXIXIXI 

X  1 

X  1 

X  1 

X  1 

X 

1  X  1 

X 

1  X  1 

X  1 

X  1 

X  1  X  1 

X  1  X  1  X  1 

IXIXSXtXIXlXI 

X  1 

X  1 

X  1 

X  1 

X 

1  X  1 

X 

I  X  1 

X  1 

X  1 

X  1  X  1 

X  1  X  1  X  1 

IXIXIXIXIXIXI 

X  1 

X  1 

X  1 

X  1 

X 

1  X  1 

X 

1  X  1 

X  1 

X  I 

X  1  X  1 

X  1  X  1  X  I 

IXIXIXIXIXIXI 

X  1 

X  1 

X  I 

X  1 

X 

1  X  I 

X 

I  X  1 

X  I 

X  I 

X  1  X  1 

X  1  X  1  X  1 

IXIXIXIXIXIXI 

X  1 

X  I 

X  1 

X  1 

X 

1  X  1 

X 

1  X  t 

X  1 

X  1 

X  I  X  1 

X 

- 

X 

- 

X 

IXIXIXIXIXIXI 

X  1 

X  1 

X  1 

X  I 

X 

1  X  1 

X 

1  X  1 

X  1 

X  1 

X  1  X  1 

X  I  X  1  X  1 

1  IXIXIXIX1XI 

X  I 

X  1 

X  1 

X  1 

X 

I  X  1 

X 

1  X  1 

X  1 

1 

1  1 

>  1  1 

1  1  1  1  1  1  1 

1 

1 

X  1 

X  1 

X 

1  X  1 

X 

1  X  1 

1 

1  1 

t  1  1 

1  1  1  1  I  1  1 

1 

1 

x  : 

X  1 

X 

1  X  1 

X 

1  X  1 

1 

1 

1  I 

1  1  I 

1  1  1  1  1  1  I 

1 

1 

X  1 

X  1 

X 

1  X  I 

X 

1  X  1 

1 

1 

I  I 

1  1  I 

I  1  I  1  1  1  1 

1 

1 

X  1 

X  1 

X 

1  X  1 

X 

I  X  1 

1 

5 

1  1 

1  1  1 

t  1  1  1  1  1  I 

l 

I 

X  1 

X  1 

X 

I  X  1 

X 

;  x  ; 

1 

1 

1  ! 

1  1  1 

i  i  :  i  i  i  i 

1 

X  1 

X  1 

X  1 

X 

1  X  1 

X 

1  X  1 

X  1 

X  1 

X  I  X  l 

XI  I  1 

1  1  1  l  1  1  I 

■ 

X  1 

X  I 

X  1 

X 

1  X  1 

X 

1  X  1 

X  1 

X  1 

X  1  X  1 

XI  I  1 

1  1  1  1  1  1  1 

1 

X  1 

X  1 

X  1 

X 

:  x  i 

X 

1  X  1 

X  1 

x  1 

X  1  X  I 

XI  1  1 

Fig. 

38. 

Renfanalpfi  Produced  bv 

1  1  I  1  1  1  1 

1 

1 

_i 

_ 

1  1 

_ 

1  1 

1 

1 

1  1 

1  1  1 

Section  Delimiter  *  7. 

10.  CONCLUSIONS  AND  RECOMMENDATIONS 


There  are  basic  differences  between  MAO  (multiaperture  optics)  and 
SLO  (single  lens  optics)  as  well  as  gradual  ones.  Certainly  the  en¬ 
trance  aperture  of  the  eyelets  is  smaller  than  in  the  case  of  SLO  which 
is  a  gradual  difference.  In  the  first  approximation  one  would  say  this 
causes  a  reduced  resolving  power  for  MAO.  While  this  is  a  correct  con¬ 
clusion,  the  resolving  power  of  (apposition)  MAO  is  actually  determined 
by  the  number  of  eyelets  rather  than  the  eyelet  diameter,  which  is  a 
basic  difference  between  MAO  and  SLO. 

Therefore  the  goal  should  be*to  use  as  many  eyelets  as  possible. 
However,  this  distributes  the  available  photon  flux  over  larger  and 
larger  detector  areas,  which  limits  the  achievable  signal  to  noise 
ratio.  For  this  reason  even  nature  limits  the  number  of  eyelets  used. 
The  entrance  aperture  of  individual  eyelets  used  by  nature  is  still 
between  100  and  500  times  the  wavelength  of  light  instead  of  one  times 
which  would  be  a  theoretical  limit.  In  an  artificial  device  one  would 
limit  the  number  of  eyelets  even  more. 

To  make  good  for  the  limited  resolution  of  the  so  obtained  system, 
an  attempt  should  be  made  to  extract  more  information  than  just  the 
existence  of  one  pixel  from  the  footprint  of  each  eyelet. 

In  the  system  described  in  this  report,  we  do  this  only  in  a  pri¬ 
mitive  way,  namely  requiring  that  one  of  the  9  detectors  producing  a 
signal  within  one  given  footprint  has  to  be  the  center  detector.  In 
addition  we  require  also  the  presence  of  intensity  on  a  certain  number 
of  other  detectors  within  the  same  footprint.  The  latter  amounts  to 


thresholding,  although  at  a  later  stage  of  development  this  may  be  used 
to  construct  a  gray  scale.  The  important  feature,  however,  is  require¬ 
ment  for  the  presence  of  the  center  detector.  Since  the  system  "knows" 
which  one  the  center  detect  is,  and  since  this  detector  has  a  non-over¬ 
lapping  FOV,  the  combination  of  center  detector  and  outer  detector  al¬ 
lows  deduction  of  additional  information.  An  example  is  the  case  where 
an  edge  goes  through  the  middle  of  an  eyelet.  The  outer  detector  will 
tell  in  which  direction  the  illuminated  part  is,  while  the  presence  of 
the  center  detector  tells  that  the  edge  goes  through  the  FOV  of  the 
eyelet  (presumably  near  the  center).  Therefore,  this  gives  a  better 
resolution  than  should  be  expected. 

A  check  for  illuminated  detectors  under  void  spaces,  where  the 
neighboring  footprints  do  not  have  a  center  detector  illuminated,  will 
give  an  indication  of  the  noise  present. 

Checking  for  coincidences  between  detectors  having  overlapping 
FOVs  will  help  improve  the  signal  to  noise  ratio. 

All  these  features  still  need  to  be  incorporated  in  the  image 
evaluation  system. 

Also,  the  problem  of  rotating  the  image  after  each  unsuccessful 
recognition  attempt  still  needs  to  be  incorporated. 

However,  the  present  effort  shows  that  a  MAO  device  which  can 
recognize  simple  patterns  using  a  minimum  of  computational  effort  can 
indeed  be  built  as  an  inexpensive  mass  product  as  well  as  a  physically 


small  device 
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